-- Logs begin at Wed 2022-11-02 06:44:52 UTC, end at Wed 2022-11-02 08:04:33 UTC. -- Nov 02 07:21:15.188769 dv-cinder-778193-30-smb systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 07:21:15.200150 dv-cinder-778193-30-smb devstack@keystone.service[81588]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 07:21:15 2022] *** Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: nodename: dv-cinder-778193-30-smb Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: machine: x86_64 Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: clock source: unix Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: pcre jit disabled Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: detected number of CPU cores: 4 Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: current working directory: / Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: detected binary path: /usr/bin/uwsgi-core Nov 02 07:21:15.202071 dv-cinder-778193-30-smb devstack@keystone.service[81588]: your processes number limit is 47680 Nov 02 07:21:15.202808 dv-cinder-778193-30-smb devstack@keystone.service[81588]: your memory page size is 4096 bytes Nov 02 07:21:15.202808 dv-cinder-778193-30-smb devstack@keystone.service[81588]: detected max file descriptor number: 2048 Nov 02 07:21:15.202808 dv-cinder-778193-30-smb devstack@keystone.service[81588]: lock engine: pthread robust mutexes Nov 02 07:21:15.202808 dv-cinder-778193-30-smb devstack@keystone.service[81588]: thunder lock: enabled Nov 02 07:21:15.202808 dv-cinder-778193-30-smb devstack@keystone.service[81588]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 07:21:15.202808 dv-cinder-778193-30-smb devstack@keystone.service[81588]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 07:21:15.241253 dv-cinder-778193-30-smb devstack@keystone.service[81588]: Python main interpreter initialized at 0x562b39e1c9c0 Nov 02 07:21:15.241253 dv-cinder-778193-30-smb devstack@keystone.service[81588]: python threads support enabled Nov 02 07:21:15.241253 dv-cinder-778193-30-smb devstack@keystone.service[81588]: your server socket listen backlog is limited to 100 connections Nov 02 07:21:15.241253 dv-cinder-778193-30-smb devstack@keystone.service[81588]: your mercy for graceful operations on workers is 90 seconds Nov 02 07:21:15.241579 dv-cinder-778193-30-smb devstack@keystone.service[81588]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 07:21:15.241661 dv-cinder-778193-30-smb devstack@keystone.service[81588]: *** Operational MODE: preforking *** Nov 02 07:21:15.241919 dv-cinder-778193-30-smb devstack@keystone.service[81588]: *** uWSGI is running in multiple interpreter mode *** Nov 02 07:21:15.241919 dv-cinder-778193-30-smb devstack@keystone.service[81588]: spawned uWSGI master process (pid: 81588) Nov 02 07:21:15.242108 dv-cinder-778193-30-smb systemd[1]: Started Devstack devstack@keystone.service. Nov 02 07:21:15.244484 dv-cinder-778193-30-smb devstack@keystone.service[81588]: spawned uWSGI worker 1 (pid: 81601, cores: 1) Nov 02 07:21:15.244484 dv-cinder-778193-30-smb devstack@keystone.service[81588]: spawned uWSGI worker 2 (pid: 81602, cores: 1) Nov 02 07:21:15.244484 dv-cinder-778193-30-smb devstack@keystone.service[81588]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 07:21:19.578386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:19.578386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: from cryptography.utils import int_from_bytes Nov 02 07:21:19.579134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:19.579134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: from cryptography.utils import int_from_bytes Nov 02 07:21:19.579879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:19.579879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: from cryptography.utils import int_from_bytes Nov 02 07:21:19.580340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 07:21:19.580340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: from cryptography.utils import int_from_bytes Nov 02 07:21:19.631523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:21:19.631714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:21:19.631904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] command line args: [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:21:19.632102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 07:21:19.632192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:21:19.632300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 07:21:19.632381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ================================================================================ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:21:19.632518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] command line args: [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 07:21:19.632612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] admin_token = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.632793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 07:21:19.632879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config_dir = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.632957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ================================================================================ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 07:21:19.633033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.633157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] config_source = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.633243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] admin_token = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.633335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] debug = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.633493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_dir = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.633576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.633822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.633938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_source = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] debug = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.634889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_config_append = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_dir = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.635749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_config_append = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.636344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.636425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.636425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_dir = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.636639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.636763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.636847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.636926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.637956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.638900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] publish_errors = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.639928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640373 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] publish_errors = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.640998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] standard_threads = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] standard_threads = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.641935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_journal = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_json = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_stderr = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] use_syslog = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_journal = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_json = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.642906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.642986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_stderr = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.643186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.643323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_syslog = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.643440 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.643521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 07:21:19.643593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.643669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.643819 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.643900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.644888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.645976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.646928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.647962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.648978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.649893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.650966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.651044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.651197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.651280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.651487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.651583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.652217 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.652297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.652469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.652551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.655417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.655551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.655911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.656964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.657958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.658964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659437 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.659996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660674 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.660939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661223 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.661885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.662960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663740 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.663985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.664961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.665919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.666949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667439 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.667997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.external = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.668987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.password = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] auth.token = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.external = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.669912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670373 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.password = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.token = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.670996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.671946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.672974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.673975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.674955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.675898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676630 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.676887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677726 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.677954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.678983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.679944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.680993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.681944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.682922 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683002 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683853 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.683942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.684907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685382 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.685988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.686996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.687968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.688070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.688212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.688303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.688496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.688582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.688690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.688887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.689748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.689862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.689943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.690954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.691953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.692901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.693871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.694953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.695964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.696920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697771 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.697888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.698010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.698090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.698239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.698824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.699959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.700936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.701962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.702919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703630 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.703874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.704860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.705960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.706122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.706203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.706367 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.706449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.706609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.706806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.706886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.707983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.708934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709630 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.709934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710168 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.710876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.711982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.712069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.712218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.712298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.712463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.712582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.712702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.712915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.713025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.713162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.713357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.713464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.713653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.713774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.714626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.714910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.715122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.715369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.715449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.715633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.715714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.715915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.715998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716674 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.716993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.717980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.718924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.719944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.720095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.720176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.720257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:21:19.720379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.720641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.720887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.721118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.721359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.721597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 07:21:19.721769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 07:21:19.749361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.749588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.749810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.750255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.750489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.750718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.758084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.758989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.791777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.792002 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.792275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.792536 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.844533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.845232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.893113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.893345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.894427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:19.894663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.058642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.058952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.059236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.059519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.059607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.059816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.059908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.060043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.060204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.060288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.060489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.060705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.083639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.083947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.084042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.084254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.084341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.084506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.084684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.084770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.084929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.085012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.085139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.085349 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.085432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.085672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.103648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.104449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.116329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.116649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.116744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.116937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.117910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.118097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.118185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 07:21:20.140147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.140411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:20.140525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.140643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:20.140784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.140981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.141081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:20.141187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 07:21:20.141295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.141456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.141544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.141716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.141974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.142060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.142296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.142477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.151666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.151778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.151947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.152040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.152218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.152304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.152527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.152629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.159721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.159872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.162623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.162843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.162946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.163128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.163214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.163411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.163496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.163693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.163780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.163955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.164038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.164223 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.164317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.164514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.164600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.164789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.164902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.165172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.165269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.165438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.165521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.165706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.188336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.189077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.189807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.190089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.190588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.190873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.196626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.196708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.196988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.197390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.197677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.197960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.204093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.204385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.205356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.205646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.208547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.208832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.209109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.209387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.209659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.209870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.209964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.210162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.210248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.210448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.210531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.210730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.211009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.211298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.211567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.211843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.226104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.226374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.227665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.227942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.230789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.232417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.234014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.234316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.235667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.235973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.238504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.240242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.241642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.243395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.244902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.245232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.246148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.246445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.246728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.247000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.247263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.247563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.247861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.248159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.248465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.248751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.262870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.263155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.263421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.263685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.264731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.265018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.265286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.265550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.270537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.272067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.272465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.273677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.273965 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.274049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.275565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.275851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.276609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.276942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.277278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.277559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.277839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.278579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.278869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.279257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.279543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.279825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.289195 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.289475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.289849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.290128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.290416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.290704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.290976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.291313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.291598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.291975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.292840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.293133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.293423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.293704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.306953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.310148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.310419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.313124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.313307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.314737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.316068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.316338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.316645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.316935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.317658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.319273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.319559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.319847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.323255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.324767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.326291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.327743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.327846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.328032 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.328313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.328612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.330871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.334989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.334989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.334989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.336379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.336693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.336973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.339662 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.339955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.340240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.344749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.345035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.345315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.345590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.345858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.346125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.346395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.346677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.346941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.347203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.347486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.347761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.348081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.348175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 07:21:20.348283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.348491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.348633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.348893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.349167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.349479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.349767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.350043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.350311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.350579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.350857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.351143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.351407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.351678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 07:21:20.382125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562b39e1c9c0 pid: 81601 (default app) Nov 02 07:21:20.385278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243e51-bd6a-4c0e-95bf-e8c7904eb053 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:20.385562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243e51-bd6a-4c0e-95bf-e8c7904eb053 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:20.385856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243e51-bd6a-4c0e-95bf-e8c7904eb053 None None] PATH_INFO: `/v3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:20.386237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562b39e1c9c0 pid: 81602 (default app) Nov 02 07:21:20.389952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Wed Nov 2 07:21:20 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:28.119415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82180-b386-4356-8dfd-966e43809213 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:28.120253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82180-b386-4356-8dfd-966e43809213 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:28.120575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82180-b386-4356-8dfd-966e43809213 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:28.124825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:28.131900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:28.131900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:28.131900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:28.200867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: INFO dbcounter [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] Registered counter for database keystone Nov 02 07:21:28.220301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG oslo_db.sqlalchemy.engines [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:21:28.226820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writer thread running {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:21:28.405598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG passlib.handlers.bcrypt [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81601) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:21:28.406157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG passlib.handlers.bcrypt [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81601) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:21:28.463689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:28.465927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:28.591429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 07:21:29.060040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f82180-b386-4356-8dfd-966e43809213 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:29.128483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: INFO dbcounter [None req-d6f82180-b386-4356-8dfd-966e43809213 None None] Registered counter for database keystone Nov 02 07:21:29.150259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f82180-b386-4356-8dfd-966e43809213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 07:21:29.156755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writer thread running {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 07:21:29.272454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f82180-b386-4356-8dfd-966e43809213 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:29.276697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80950ec6-6e28-49d8-b87c-070e57944443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:29.277320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950ec6-6e28-49d8-b87c-070e57944443 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:29.277592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950ec6-6e28-49d8-b87c-070e57944443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:29.277857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950ec6-6e28-49d8-b87c-070e57944443 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:29.286210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80950ec6-6e28-49d8-b87c-070e57944443 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:29.337648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING keystone.common.rbac_enforcer.enforcer [None req-80950ec6-6e28-49d8-b87c-070e57944443 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:21:29.338044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80950ec6-6e28-49d8-b87c-070e57944443 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:29.347121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Nov 2 07:21:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:21:29.353014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:29.371721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bec276-39de-4f7d-a604-e2cb349836b3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:29.377611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b547b2-e777-40eb-9c0a-1efa29cf78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:29.378718 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b547b2-e777-40eb-9c0a-1efa29cf78ed admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:29.378995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b547b2-e777-40eb-9c0a-1efa29cf78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:29.379262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b547b2-e777-40eb-9c0a-1efa29cf78ed admin admin] PATH_INFO: `/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:29.383048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b547b2-e777-40eb-9c0a-1efa29cf78ed admin admin] RBAC: Authorizing `identity:get_project(project_id=a2956e4c40564dd2b6b8960e97f61ae3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:29.433679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING keystone.common.rbac_enforcer.enforcer [None req-85b547b2-e777-40eb-9c0a-1efa29cf78ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 07:21:29.434017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b547b2-e777-40eb-9c0a-1efa29cf78ed admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:29.438425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Nov 2 07:21:29 2022] GET /identity/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:31.551417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e118b24-b11d-4127-a6b1-525304c463b7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:31.551897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e118b24-b11d-4127-a6b1-525304c463b7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:31.551897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e118b24-b11d-4127-a6b1-525304c463b7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:31.555954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:21:31.561693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e3db-bbfa-418e-b2e3-57dd37180047 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:31.562110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e3db-bbfa-418e-b2e3-57dd37180047 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:31.562242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0e3db-bbfa-418e-b2e3-57dd37180047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:31.582708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-36c0e3db-bbfa-418e-b2e3-57dd37180047 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:31.584246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-36c0e3db-bbfa-418e-b2e3-57dd37180047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:31.592654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:21:31.860754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e118b24-b11d-4127-a6b1-525304c463b7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:31.873317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e118b24-b11d-4127-a6b1-525304c463b7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:31.877480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3126c-ce2f-4458-9d8c-e763f7b92cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:31.878070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3126c-ce2f-4458-9d8c-e763f7b92cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:31.878352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3126c-ce2f-4458-9d8c-e763f7b92cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:31.878624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3126c-ce2f-4458-9d8c-e763f7b92cbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:31.886764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3126c-ce2f-4458-9d8c-e763f7b92cbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:31.888564 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3126c-ce2f-4458-9d8c-e763f7b92cbc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:31.897133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Nov 2 07:21:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:21:31.902417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0e3db-bbfa-418e-b2e3-57dd37180047 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:31.911575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0e3db-bbfa-418e-b2e3-57dd37180047 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:31.915857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bff1d-0ec9-4d1a-9fe6-d4cf7e537968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:31.916505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bff1d-0ec9-4d1a-9fe6-d4cf7e537968 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:31.916785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bff1d-0ec9-4d1a-9fe6-d4cf7e537968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:31.917071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bff1d-0ec9-4d1a-9fe6-d4cf7e537968 admin admin] PATH_INFO: `/v3/users/c3037fdb5af64eb3a7204825aff76bfd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:31.918418 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bff1d-0ec9-4d1a-9fe6-d4cf7e537968 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3037fdb5af64eb3a7204825aff76bfd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:31.920545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bff1d-0ec9-4d1a-9fe6-d4cf7e537968 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:31.922051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Wed Nov 2 07:21:31 2022] GET /identity/v3/users/c3037fdb5af64eb3a7204825aff76bfd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:34.112360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e917a-3137-4daa-bd18-2192271c5cce None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.112922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e917a-3137-4daa-bd18-2192271c5cce None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.112922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e917a-3137-4daa-bd18-2192271c5cce None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.114261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:34.119376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08dbcc-85f2-4af4-85d1-f62aa3b03b63 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.120221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08dbcc-85f2-4af4-85d1-f62aa3b03b63 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.120717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08dbcc-85f2-4af4-85d1-f62aa3b03b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.138504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cf08dbcc-85f2-4af4-85d1-f62aa3b03b63 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:34.139681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cf08dbcc-85f2-4af4-85d1-f62aa3b03b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:34.168690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be731d-67f2-43ed-930a-30e005e7949d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.168970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be731d-67f2-43ed-930a-30e005e7949d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.169237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be731d-67f2-43ed-930a-30e005e7949d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.170546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:21:34.175396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.175675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.175951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.216908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG passlib.handlers.bcrypt [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81602) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 07:21:34.217283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG passlib.handlers.bcrypt [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81602) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 07:21:34.223551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:34.266042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:34.267593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:34.367191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:21:34.489402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08dbcc-85f2-4af4-85d1-f62aa3b03b63 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:34.513291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:34.592355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08dbcc-85f2-4af4-85d1-f62aa3b03b63 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:34.624796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:34.625359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.625636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.625905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.633820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:34.638660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:34.647092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:34.648033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:34.649035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:21:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:34.654550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:34.733123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cdf7d-0e48-42f8-8364-e5d4981b9dee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:34.734732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:34.735619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:34.753622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d5785-73bd-4833-beaa-15ed1fba38f3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:34.774357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:34.776415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.776415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.776415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.777401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:34.778870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:34.789312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:34.789912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.790188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.790454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.791112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:34.791401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:34.792841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:34.804847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:34.810903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:34.834453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:21:34.834453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:21:34.834453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [parameters: {'id': 'c0b813321dd7460d936f5ee9e6f75295', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:21:34.834453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:21:34.853051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:21:34.867972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:21:34.868978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:21:34.869826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:21:34.871237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:21:34.872000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'id': 'c0b813321dd7460d936f5ee9e6f75295', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:21:34.872831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:34.873557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 8/16] 10.222.0.39 () {60 vars in 1137 bytes} [Wed Nov 2 07:21:34 2022] POST /identity/v3/domains => generated 190 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:21:34.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:34.912302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7b6c-4f3c-4976-94ed-e6875aa8c51f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:34.944999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:34.945640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.945917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.946179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] PATH_INFO: `/v3/users/c3037fdb5af64eb3a7204825aff76bfd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:34.947299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] RBAC: Authorizing `identity:get_user(user_id=c3037fdb5af64eb3a7204825aff76bfd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:34.949322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:34.950875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:34 2022] GET /identity/v3/users/c3037fdb5af64eb3a7204825aff76bfd => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:34.956188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:34.959437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd57c7-b5cf-45a7-a6c7-82581540b222 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:34.969882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:34.991306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:34.992146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:34.992420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:34.992716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:35.010559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:35.012607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:21:35.028766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:35.029646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:21:35.030609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:21:35.030609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:35.030609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:35.030609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:21:35.035934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:35.055304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c033f70-047c-47fe-bb53-d7dfb228fa53 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:35.060220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:35.091299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:35.091936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:35.092212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:35.092534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:35.093642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:35.095076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:35.096630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:35.102159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:35.139342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455442a1-7722-4902-8c3c-85cb47ab4da8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:35.173503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e4166-6ffe-4c90-9c8a-ab6fa994016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:35.174141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4166-6ffe-4c90-9c8a-ab6fa994016c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:35.174422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4166-6ffe-4c90-9c8a-ab6fa994016c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:35.174689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4166-6ffe-4c90-9c8a-ab6fa994016c None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:35.175325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e4166-6ffe-4c90-9c8a-ab6fa994016c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:35.175623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e4166-6ffe-4c90-9c8a-ab6fa994016c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:35.177048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e4166-6ffe-4c90-9c8a-ab6fa994016c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:35.184089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:35.194768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:35.203538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e0c54-4be3-479e-bd03-8ca36a90abc3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:35.241190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7968b1-e416-4183-80fa-d485cd67d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:35.241863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7968b1-e416-4183-80fa-d485cd67d0af None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:35.242139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7968b1-e416-4183-80fa-d485cd67d0af None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:35.242410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7968b1-e416-4183-80fa-d485cd67d0af None admin] PATH_INFO: `/v3/domains/default/users/c3037fdb5af64eb3a7204825aff76bfd/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:35.244407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7968b1-e416-4183-80fa-d485cd67d0af None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c3037fdb5af64eb3a7204825aff76bfd, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:35.246518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7968b1-e416-4183-80fa-d485cd67d0af None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:35.508283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 11/21] 10.222.0.39 () {58 vars in 1361 bytes} [Wed Nov 2 07:21:35 2022] PUT /identity/v3/domains/default/users/c3037fdb5af64eb3a7204825aff76bfd/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:21:37.719532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c48f-4db5-45e9-8b98-37eb327708d7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:37.720088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c48f-4db5-45e9-8b98-37eb327708d7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:37.720088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c48f-4db5-45e9-8b98-37eb327708d7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:37.721860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:37.728280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6ae5-3295-4a4b-816c-da9f63e002f3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:37.728819 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6ae5-3295-4a4b-816c-da9f63e002f3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:37.728930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af6ae5-3295-4a4b-816c-da9f63e002f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:37.749242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-28af6ae5-3295-4a4b-816c-da9f63e002f3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:37.750815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-28af6ae5-3295-4a4b-816c-da9f63e002f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:37.823902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:37.829309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9625b3-a61d-40b4-82d6-fac163ccc34e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:37.829594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9625b3-a61d-40b4-82d6-fac163ccc34e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:37.829868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9625b3-a61d-40b4-82d6-fac163ccc34e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:37.831434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:37.836196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dd77a-2014-4690-9f55-156b688f1bde None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:37.836511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dd77a-2014-4690-9f55-156b688f1bde None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:37.836789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dd77a-2014-4690-9f55-156b688f1bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:37.862327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-667dd77a-2014-4690-9f55-156b688f1bde None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:37.863502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-667dd77a-2014-4690-9f55-156b688f1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:37.897668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb078f-1b4d-4040-9a3e-47f213b9bec9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:37.897975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb078f-1b4d-4040-9a3e-47f213b9bec9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:37.898205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb078f-1b4d-4040-9a3e-47f213b9bec9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:37.899849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 13/25] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:37.905266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77cb61-2588-40a1-b9d5-df45070a5e9c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:37.905543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77cb61-2588-40a1-b9d5-df45070a5e9c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:37.906231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77cb61-2588-40a1-b9d5-df45070a5e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:37.941882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ba77cb61-2588-40a1-b9d5-df45070a5e9c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:37.943080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ba77cb61-2588-40a1-b9d5-df45070a5e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:37.965736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:37.979580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:38.061297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:21:38.214123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dd77a-2014-4690-9f55-156b688f1bde None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:38.330550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dd77a-2014-4690-9f55-156b688f1bde None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:38.375108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:38.375660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:38.375938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:38.376205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:38.377086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77cb61-2588-40a1-b9d5-df45070a5e9c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:38.396425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:38.398477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:38.400944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:21:38.425925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:38.426871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:21:38.427690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:21:38.427690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:21:38.427690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:38.428064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 14/28] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:38.438291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:38.531572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:38.549597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77cb61-2588-40a1-b9d5-df45070a5e9c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:38.603716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff5119-e5ce-4770-9be3-402bb7d2bca7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:38.641172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303ef5d-3a2c-4208-960f-a661c82d3ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:38.642035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303ef5d-3a2c-4208-960f-a661c82d3ab0 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:38.642459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303ef5d-3a2c-4208-960f-a661c82d3ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:38.642896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303ef5d-3a2c-4208-960f-a661c82d3ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:38.643777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303ef5d-3a2c-4208-960f-a661c82d3ab0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:38.645363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303ef5d-3a2c-4208-960f-a661c82d3ab0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:38.661588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:38.662225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:38.662510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:38.662787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:38.663510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:38.663872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:38.665390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:38.691954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 15/29] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:38.692884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:38.824677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89705-4511-4c33-9f23-f4e112e899bf None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:38.840295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:38.862786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:38.863354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:38.863636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:38.863961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:38.874823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:38.880128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:38.881023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:38.881787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 16/30] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:21:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:38.882410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:38.904986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 15/31] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Nov 2 07:21:38 2022] POST /identity/v3/roles => generated 219 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:38.907302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a184b-6fcf-4273-b588-10a00ba055d6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:38.907795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a184b-6fcf-4273-b588-10a00ba055d6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:38.908276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a184b-6fcf-4273-b588-10a00ba055d6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:38.910053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 16/32] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:38.915253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a184b-6fcf-4273-b588-10a00ba055d6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:38.998989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:39.035580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a184b-6fcf-4273-b588-10a00ba055d6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:39.075025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed318333-d6df-4b0c-87d3-4adee98cd88d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:39.076494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af0e65-ae25-416f-98d0-d3386e7b90f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:39.077447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af0e65-ae25-416f-98d0-d3386e7b90f4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.078059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af0e65-ae25-416f-98d0-d3386e7b90f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.078538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af0e65-ae25-416f-98d0-d3386e7b90f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.079408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af0e65-ae25-416f-98d0-d3386e7b90f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:39.079905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af0e65-ae25-416f-98d0-d3386e7b90f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:39.081671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af0e65-ae25-416f-98d0-d3386e7b90f4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:39.097501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 17/33] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:39.099206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbedbd-8fbf-4bdb-b405-cbebbf8ca545 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.099689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbedbd-8fbf-4bdb-b405-cbebbf8ca545 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.100175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbedbd-8fbf-4bdb-b405-cbebbf8ca545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.133301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-36fbedbd-8fbf-4bdb-b405-cbebbf8ca545 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:39.133301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-36fbedbd-8fbf-4bdb-b405-cbebbf8ca545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:39.139522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:39.140230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.140555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.140885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.141653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:39.143225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:39.213233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 18/34] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:39.215052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbedbd-8fbf-4bdb-b405-cbebbf8ca545 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:39.266889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 17/35] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:21:38 2022] POST /identity/v3/projects => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:39.290953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:39.341614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbedbd-8fbf-4bdb-b405-cbebbf8ca545 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:39.386912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:39.387894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.388457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.389045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] PATH_INFO: `/v3/users/c3037fdb5af64eb3a7204825aff76bfd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.390766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] RBAC: Authorizing `identity:get_user(user_id=c3037fdb5af64eb3a7204825aff76bfd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:39.392508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:39.394376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 19/36] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:39 2022] GET /identity/v3/users/c3037fdb5af64eb3a7204825aff76bfd => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:39.400337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:39.445188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:39.553094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:39.553981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba0299-afe0-4bca-a6b5-1e6aca34c30f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:39.597537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec84a5-c8e1-423d-82d5-afcd36aeab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:39.600537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec84a5-c8e1-423d-82d5-afcd36aeab6f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.602503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec84a5-c8e1-423d-82d5-afcd36aeab6f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.602997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec84a5-c8e1-423d-82d5-afcd36aeab6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.609036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec84a5-c8e1-423d-82d5-afcd36aeab6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:39.611362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec84a5-c8e1-423d-82d5-afcd36aeab6f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:39.613512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 18/37] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:39.615511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d87d-2ac0-4d0b-b5aa-eec0f8bbd209 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.616024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d87d-2ac0-4d0b-b5aa-eec0f8bbd209 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.616695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d87d-2ac0-4d0b-b5aa-eec0f8bbd209 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.618275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 19/38] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:39.625016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d87d-2ac0-4d0b-b5aa-eec0f8bbd209 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:39.701254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662be8b-7502-492f-b034-de36a005ee25 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:39.739348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:39.745388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44800243-80aa-46db-8073-fd02df6fb208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:39.746030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44800243-80aa-46db-8073-fd02df6fb208 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.746313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44800243-80aa-46db-8073-fd02df6fb208 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.746588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44800243-80aa-46db-8073-fd02df6fb208 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.747286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44800243-80aa-46db-8073-fd02df6fb208 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:39.748734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44800243-80aa-46db-8073-fd02df6fb208 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:39.834409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Nov 2 07:21:39 2022] POST /identity/v3/roles => generated 225 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:39.835688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34e54-5ff2-419c-ba60-a0050fb41ada None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.835974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34e54-5ff2-419c-ba60-a0050fb41ada None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.836253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34e54-5ff2-419c-ba60-a0050fb41ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.842510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:39.853264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d87d-2ac0-4d0b-b5aa-eec0f8bbd209 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:39.859479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0fc34e54-5ff2-419c-ba60-a0050fb41ada None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:39.860758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0fc34e54-5ff2-419c-ba60-a0050fb41ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:39.892730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13286aae-6664-4567-be06-34cf144d2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:39.893432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286aae-6664-4567-be06-34cf144d2795 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.893716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286aae-6664-4567-be06-34cf144d2795 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.893988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13286aae-6664-4567-be06-34cf144d2795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.894734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13286aae-6664-4567-be06-34cf144d2795 None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.domain.id=default, user.id=c3037fdb5af64eb3a7204825aff76bfd) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:39.895056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13286aae-6664-4567-be06-34cf144d2795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:39.896590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13286aae-6664-4567-be06-34cf144d2795 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:39.905011 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 20/40] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Nov 2 07:21:39 2022] GET /identity/v3/role_assignments?user.id=c3037fdb5af64eb3a7204825aff76bfd&scope.domain.id=default&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 530 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:39.906535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a56606-4617-4346-a97c-d22fd64666cd None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.906820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a56606-4617-4346-a97c-d22fd64666cd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.907092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a56606-4617-4346-a97c-d22fd64666cd None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.908697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 21/41] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:39.914535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43cdfe-aa62-434a-b88d-852b7d539724 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:39.914825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43cdfe-aa62-434a-b88d-852b7d539724 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:39.915093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43cdfe-aa62-434a-b88d-852b7d539724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:39.935295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fa43cdfe-aa62-434a-b88d-852b7d539724 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:39.936970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa43cdfe-aa62-434a-b88d-852b7d539724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:39.961810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 21/42] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:40.035186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 22/43] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:21:40.241468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc34e54-5ff2-419c-ba60-a0050fb41ada None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:40.301823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43cdfe-aa62-434a-b88d-852b7d539724 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:40.340093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc34e54-5ff2-419c-ba60-a0050fb41ada None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:40.360507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:40.374961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d188a-913e-41a8-ba49-219727c43373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:40.375572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d188a-913e-41a8-ba49-219727c43373 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:40.375849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d188a-913e-41a8-ba49-219727c43373 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:40.376131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d188a-913e-41a8-ba49-219727c43373 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:40.376844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d188a-913e-41a8-ba49-219727c43373 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:40.378217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d188a-913e-41a8-ba49-219727c43373 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:40.385413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:40.400707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43cdfe-aa62-434a-b88d-852b7d539724 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:40.433995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:40.434612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:40.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:40.435163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:40.436250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:40.437702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:40.439382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 23/44] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:40.445037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:40.488482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Nov 2 07:21:40 2022] POST /identity/v3/roles => generated 223 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:40.550886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebeff4-0545-46ea-8b01-fe3dea43b7bb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:40.587881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc7408-a676-470f-9251-e07e308788bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:40.588666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7408-a676-470f-9251-e07e308788bf None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:40.589465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7408-a676-470f-9251-e07e308788bf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:40.589733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7408-a676-470f-9251-e07e308788bf None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:40.590389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7408-a676-470f-9251-e07e308788bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:40.591832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7408-a676-470f-9251-e07e308788bf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:40.670957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:21:40 2022] POST /identity/v3/projects => generated 312 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:21:42.812053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8441693-025b-482a-ad92-c7de53806707 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:42.812636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8441693-025b-482a-ad92-c7de53806707 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:42.812636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8441693-025b-482a-ad92-c7de53806707 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:42.813995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:42.819248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c48e-6ae1-4e41-bd13-4bb2a4b09191 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:42.819636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c48e-6ae1-4e41-bd13-4bb2a4b09191 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:42.819805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c48e-6ae1-4e41-bd13-4bb2a4b09191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:42.832589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:42.837931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cb11c48e-6ae1-4e41-bd13-4bb2a4b09191 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:42.839371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cb11c48e-6ae1-4e41-bd13-4bb2a4b09191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:42.907317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 25/48] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:43.176706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8441693-025b-482a-ad92-c7de53806707 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:43.273794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8441693-025b-482a-ad92-c7de53806707 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:43.306942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a64b20-b367-441a-a53b-647839ef677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:43.307582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b20-b367-441a-a53b-647839ef677f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:43.307864 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b20-b367-441a-a53b-647839ef677f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:43.308136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b20-b367-441a-a53b-647839ef677f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:43.309270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a64b20-b367-441a-a53b-647839ef677f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:43.310708 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a64b20-b367-441a-a53b-647839ef677f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:43.312236 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 24/49] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:43.317886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11c48e-6ae1-4e41-bd13-4bb2a4b09191 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:43.414596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11c48e-6ae1-4e41-bd13-4bb2a4b09191 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:43.447041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725cae8-e8d5-43e5-a23d-e5bfd2236643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:43.447626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725cae8-e8d5-43e5-a23d-e5bfd2236643 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:43.448488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725cae8-e8d5-43e5-a23d-e5bfd2236643 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:43.448766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725cae8-e8d5-43e5-a23d-e5bfd2236643 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:43.449396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725cae8-e8d5-43e5-a23d-e5bfd2236643 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:43.450812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725cae8-e8d5-43e5-a23d-e5bfd2236643 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:43.455907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:43.546415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Nov 2 07:21:43 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:45.680056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c21ff-3dea-4484-bcbe-a81c8bf36944 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:45.680597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c21ff-3dea-4484-bcbe-a81c8bf36944 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:45.680679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c21ff-3dea-4484-bcbe-a81c8bf36944 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:45.681964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 25/51] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:45.687044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227d2b3-f0f1-46e9-9ef1-10901ba27da3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:45.687451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227d2b3-f0f1-46e9-9ef1-10901ba27da3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:45.687595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227d2b3-f0f1-46e9-9ef1-10901ba27da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:45.705548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8227d2b3-f0f1-46e9-9ef1-10901ba27da3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:45.706701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8227d2b3-f0f1-46e9-9ef1-10901ba27da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:45.770069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 27/52] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:46.037976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c21ff-3dea-4484-bcbe-a81c8bf36944 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:46.086748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:46.137031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c21ff-3dea-4484-bcbe-a81c8bf36944 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:46.168351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e31c1f-6bce-4787-b0da-a866e31a3072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:46.168993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e31c1f-6bce-4787-b0da-a866e31a3072 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:46.169272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e31c1f-6bce-4787-b0da-a866e31a3072 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:46.169538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e31c1f-6bce-4787-b0da-a866e31a3072 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:46.170627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e31c1f-6bce-4787-b0da-a866e31a3072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:46.172047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e31c1f-6bce-4787-b0da-a866e31a3072 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:46.173683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:46.179337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227d2b3-f0f1-46e9-9ef1-10901ba27da3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:46.275847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227d2b3-f0f1-46e9-9ef1-10901ba27da3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:46.292641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:46.308905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a521b4-3c72-4235-b00f-922534948beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:46.309497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a521b4-3c72-4235-b00f-922534948beb None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:46.309776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a521b4-3c72-4235-b00f-922534948beb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:46.310045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a521b4-3c72-4235-b00f-922534948beb None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:46.310729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a521b4-3c72-4235-b00f-922534948beb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:46.312190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a521b4-3c72-4235-b00f-922534948beb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:46.437202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 28/54] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:21:46 2022] POST /identity/v3/users => generated 275 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:49.711380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471b14-c7da-4ad2-addd-50fa021ecb8d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:49.712455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471b14-c7da-4ad2-addd-50fa021ecb8d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:49.712937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471b14-c7da-4ad2-addd-50fa021ecb8d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:49.714634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 27/55] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:49.720866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112978f4-067e-4f70-888e-6b55c210c89e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:49.721826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112978f4-067e-4f70-888e-6b55c210c89e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:49.722292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112978f4-067e-4f70-888e-6b55c210c89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:49.742279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-112978f4-067e-4f70-888e-6b55c210c89e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:49.743804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-112978f4-067e-4f70-888e-6b55c210c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:49.832533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 29/56] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:49.845839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51385093-69af-4a80-9c75-64b2249c0b32 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:49.846400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51385093-69af-4a80-9c75-64b2249c0b32 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:49.846880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51385093-69af-4a80-9c75-64b2249c0b32 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:49.848389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 28/57] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:49.853573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b8c7-1c24-40cd-85f5-3c3371333882 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:49.854621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b8c7-1c24-40cd-85f5-3c3371333882 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:49.855094 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b8c7-1c24-40cd-85f5-3c3371333882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:49.873502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6622b8c7-1c24-40cd-85f5-3c3371333882 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:49.874956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6622b8c7-1c24-40cd-85f5-3c3371333882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:49.955690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 30/58] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:50.060170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3e8f-1b25-4602-9a89-8587b3949ba5 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.060771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3e8f-1b25-4602-9a89-8587b3949ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.061232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa3e8f-1b25-4602-9a89-8587b3949ba5 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.062748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 29/59] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:50.067925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ca52b-4117-4992-80a1-005d8d6cfd20 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.068417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ca52b-4117-4992-80a1-005d8d6cfd20 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.068906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ca52b-4117-4992-80a1-005d8d6cfd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.097212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8b9ca52b-4117-4992-80a1-005d8d6cfd20 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:50.098708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8b9ca52b-4117-4992-80a1-005d8d6cfd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:50.144619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3e8f-1b25-4602-9a89-8587b3949ba5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.148214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.217122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 31/60] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:50.306004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa3e8f-1b25-4602-9a89-8587b3949ba5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.306759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ca52b-4117-4992-80a1-005d8d6cfd20 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.336750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.356782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6667e-7a84-428e-91dc-7d2fbb8bf10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:50.357403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6667e-7a84-428e-91dc-7d2fbb8bf10e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.357680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6667e-7a84-428e-91dc-7d2fbb8bf10e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.358132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6667e-7a84-428e-91dc-7d2fbb8bf10e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.371265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6667e-7a84-428e-91dc-7d2fbb8bf10e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0cb6667e-7a84-428e-91dc-7d2fbb8bf10e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:50.377742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:50.378617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:50.379369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:50.381349 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:21:50.382929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8593a-c7c2-468b-bd18-5df2fd3d4606 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.383346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8593a-c7c2-468b-bd18-5df2fd3d4606 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.383749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8593a-c7c2-468b-bd18-5df2fd3d4606 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.385826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 31/62] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:50.390757 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8593a-c7c2-468b-bd18-5df2fd3d4606 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.440129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ca52b-4117-4992-80a1-005d8d6cfd20 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.474553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a148a7-d76f-4fec-b5e4-784721f19bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:50.475190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a148a7-d76f-4fec-b5e4-784721f19bfd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.475474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a148a7-d76f-4fec-b5e4-784721f19bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.475747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a148a7-d76f-4fec-b5e4-784721f19bfd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.485622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a148a7-d76f-4fec-b5e4-784721f19bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d8a148a7-d76f-4fec-b5e4-784721f19bfd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:50.490488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:50.491361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:50.492133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 32/63] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:50.493331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f7fc-c436-4b4d-97c0-d1cd078a38af None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.493579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f7fc-c436-4b4d-97c0-d1cd078a38af None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.493862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77f7fc-c436-4b4d-97c0-d1cd078a38af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.508045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8593a-c7c2-468b-bd18-5df2fd3d4606 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.512598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4d77f7fc-c436-4b4d-97c0-d1cd078a38af None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:50.513784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4d77f7fc-c436-4b4d-97c0-d1cd078a38af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:50.534085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.544061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d1336-67e2-483c-b0ee-f176fba1aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:50.544705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1336-67e2-483c-b0ee-f176fba1aa8f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.544989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1336-67e2-483c-b0ee-f176fba1aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.545261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d1336-67e2-483c-b0ee-f176fba1aa8f None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.545925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1336-67e2-483c-b0ee-f176fba1aa8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:50.546235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1336-67e2-483c-b0ee-f176fba1aa8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:50.547665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d1336-67e2-483c-b0ee-f176fba1aa8f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:50.561225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 32/64] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:50.561225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a6c6-b355-4d5e-9569-64c43a798d3d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.561225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a6c6-b355-4d5e-9569-64c43a798d3d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.561225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a6c6-b355-4d5e-9569-64c43a798d3d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.561225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 33/65] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:50.561225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a6c6-b355-4d5e-9569-64c43a798d3d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.587805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 33/66] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:50.588630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f7fc-c436-4b4d-97c0-d1cd078a38af None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.604634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.668971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a6c6-b355-4d5e-9569-64c43a798d3d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.704313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:50.704948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.705227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.705496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.706316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:50.706621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:50.708340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:50.709687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77f7fc-c436-4b4d-97c0-d1cd078a38af None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.716278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 34/67] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:50.721680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.745692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06769db-e73f-44ff-ae59-4c70dbe13408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:50.747007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06769db-e73f-44ff-ae59-4c70dbe13408 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.747300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06769db-e73f-44ff-ae59-4c70dbe13408 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.747578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06769db-e73f-44ff-ae59-4c70dbe13408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.760973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06769db-e73f-44ff-ae59-4c70dbe13408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d06769db-e73f-44ff-ae59-4c70dbe13408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:50.766004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:50.766942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:50.767800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 34/68] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:50.769327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe93fc-aacf-4707-8ef2-507be82dc9c8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.769562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe93fc-aacf-4707-8ef2-507be82dc9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.770070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe93fc-aacf-4707-8ef2-507be82dc9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.790276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-85fe93fc-aacf-4707-8ef2-507be82dc9c8 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:50.791546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-85fe93fc-aacf-4707-8ef2-507be82dc9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:50.802669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.865168 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 35/69] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:50.869324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe93fc-aacf-4707-8ef2-507be82dc9c8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:50.934049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:50.937854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b839e5-6e3b-4376-95fb-320103816456 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.973901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:50.974540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:50.974823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:50.975099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] PATH_INFO: `/v3/users/a24fab6fb50c48feb5ea274c9c664024` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:50.975533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe93fc-aacf-4707-8ef2-507be82dc9c8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:50.992033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=a24fab6fb50c48feb5ea274c9c664024)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:50.993400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.000154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 35/70] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/users/a24fab6fb50c48feb5ea274c9c664024 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.000154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.018653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.019288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.019593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.019843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] PATH_INFO: `/v3/users/a24fab6fb50c48feb5ea274c9c664024` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.021004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] RBAC: Authorizing `identity:get_user(user_id=a24fab6fb50c48feb5ea274c9c664024)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.022455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.024049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/users/a24fab6fb50c48feb5ea274c9c664024 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.024821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.043628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.108827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608265b7-363f-450c-96c4-f6bf94be0ab0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.132082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f169dc-028d-46d9-b4c2-6065889e4948 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.148922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.149540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.149824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.150101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.150801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:51.151109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.152570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.160747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 36/72] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.161551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.168972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.169597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.169878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.170150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.180057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:51.184151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:51.185474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:51.186309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:51.187066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:51.188267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.256221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.263651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352310d-ffbd-4312-bd29-4ff8eeca5331 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.284841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9584d3e-6f81-45f4-be3b-af0ceb7e5160 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.299423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.300059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.300342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.300649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.301779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.303262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.304934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 37/74] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.305691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.319505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.320133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.320421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.320726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.321851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.323370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.325046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.325046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.392962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.405280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cfc7e-6cd5-4fc6-bb69-992de3a0e219 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.425873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442af554-65f6-4428-9df3-8befb25ec57e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.440395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.441052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.441338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.441614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.442737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.444224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.445833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 38/76] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.446597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.458942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.459566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.459850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.460125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] PATH_INFO: `/v3/users/c3037fdb5af64eb3a7204825aff76bfd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.461280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] RBAC: Authorizing `identity:get_user(user_id=c3037fdb5af64eb3a7204825aff76bfd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.462710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.464850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 39/77] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/users/c3037fdb5af64eb3a7204825aff76bfd => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.465574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.479615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.549789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4b230-cf04-41ec-97d8-76022c56c278 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.566941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b616fa-b3e7-4c8b-8df5-4ef8a290d929 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.582633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.583246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.583530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.583803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.584490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:51.584798 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.586179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.595418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 39/78] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:51.596181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.602995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.603648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.604532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.604815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/a24fab6fb50c48feb5ea274c9c664024/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.606713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] RBAC: Authorizing `identity:create_grant(project_id=34dde8575f264f5c8c8484f0d25a1802, user_id=a24fab6fb50c48feb5ea274c9c664024, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.608163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.615033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.665600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 40/79] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:21:51 2022] PUT /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/a24fab6fb50c48feb5ea274c9c664024/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:21:51.666451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.697509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17e239-9b55-4957-b1f7-d04e5720de1a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.738312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.739722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.740244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.740916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/a24fab6fb50c48feb5ea274c9c664024/roles/9633c4426fd245b7ad054ad7ca81ce1c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.743330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=34dde8575f264f5c8c8484f0d25a1802, user_id=a24fab6fb50c48feb5ea274c9c664024, role_id=9633c4426fd245b7ad054ad7ca81ce1c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.745132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.755794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.791962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4e796-71c2-4628-ac96-d362482b1c62 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:51.828912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:51.829531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:51.829813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:51.830089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:51.830799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:51.832272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:51.849757 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 40/80] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:21:51 2022] PUT /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/a24fab6fb50c48feb5ea274c9c664024/roles/9633c4426fd245b7ad054ad7ca81ce1c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:21:51.850602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.942273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:51.954616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 41/81] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:21:51 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:51.955470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:51.973335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7433-dcc8-4aa4-aa4d-0a3c185c8c8d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:52.025127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:52.027884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:52.028410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:52.028929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:52.031650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:52.033818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:52.037396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 41/82] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:52.044424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:52.140230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461c5e9-d097-4555-a27d-a1fe71570636 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:52.177030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:52.191747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf97023-6193-4697-bc73-9c6e3c1f0689 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:52.192906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:52.193802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:52.194299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:52.194767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] PATH_INFO: `/v3/users/a24fab6fb50c48feb5ea274c9c664024` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:52.196145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] RBAC: Authorizing `identity:get_user(user_id=a24fab6fb50c48feb5ea274c9c664024)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:52.198427 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:52.200282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 42/83] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:51 2022] GET /identity/v3/users/a24fab6fb50c48feb5ea274c9c664024 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:52.205746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:52.229272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:52.229971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:52.230395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:52.230672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/c3037fdb5af64eb3a7204825aff76bfd/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:52.232689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=34dde8575f264f5c8c8484f0d25a1802, user_id=c3037fdb5af64eb3a7204825aff76bfd, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:52.234157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:52.319377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 42/84] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:21:52 2022] PUT /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/c3037fdb5af64eb3a7204825aff76bfd/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:21:52.323169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a12b47-95e5-416c-a3fb-ef09a09b905b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:52.364480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4016-e12a-4be2-a068-470675eb307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:52.365527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4016-e12a-4be2-a068-470675eb307d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:52.366062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4016-e12a-4be2-a068-470675eb307d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:52.366537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4016-e12a-4be2-a068-470675eb307d None admin] PATH_INFO: `/v3/projects/22fa3c28f6ee4103b6ffeb0861df03ee` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:52.368176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e4016-e12a-4be2-a068-470675eb307d None admin] RBAC: Authorizing `identity:get_project(project_id=22fa3c28f6ee4103b6ffeb0861df03ee)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:52.370498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e4016-e12a-4be2-a068-470675eb307d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:52.372692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 43/85] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:52 2022] GET /identity/v3/projects/22fa3c28f6ee4103b6ffeb0861df03ee => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:52.378747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:52.390586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:52.500147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf9b6-0bfa-4008-9e09-246159bc54b4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:52.546736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0636d34-a756-4976-998c-1a81c390e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:52.547421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0636d34-a756-4976-998c-1a81c390e32c None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:52.547704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0636d34-a756-4976-998c-1a81c390e32c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:52.547977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0636d34-a756-4976-998c-1a81c390e32c None admin] PATH_INFO: `/v3/projects/22fa3c28f6ee4103b6ffeb0861df03ee/users/a24fab6fb50c48feb5ea274c9c664024/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:52.550004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0636d34-a756-4976-998c-1a81c390e32c None admin] RBAC: Authorizing `identity:create_grant(project_id=22fa3c28f6ee4103b6ffeb0861df03ee, user_id=a24fab6fb50c48feb5ea274c9c664024, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:52.551495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0636d34-a756-4976-998c-1a81c390e32c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:52.627827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 43/86] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:21:52 2022] PUT /identity/v3/projects/22fa3c28f6ee4103b6ffeb0861df03ee/users/a24fab6fb50c48feb5ea274c9c664024/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:21:54.385226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438419a-dd9d-45cd-b382-95dd91cb81a6 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.385702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438419a-dd9d-45cd-b382-95dd91cb81a6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.385702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438419a-dd9d-45cd-b382-95dd91cb81a6 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.387290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 44/87] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:54.393060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0711d7-37c0-4da5-9d3c-5980cdc31477 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.393473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0711d7-37c0-4da5-9d3c-5980cdc31477 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.393641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0711d7-37c0-4da5-9d3c-5980cdc31477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.420455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2f0711d7-37c0-4da5-9d3c-5980cdc31477 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:54.421675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2f0711d7-37c0-4da5-9d3c-5980cdc31477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:54.506109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:54.516586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 44/88] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:54.701743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412ea83-7b4f-4b51-a319-50deb1dfc1fe None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.702068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412ea83-7b4f-4b51-a319-50deb1dfc1fe None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.702278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412ea83-7b4f-4b51-a319-50deb1dfc1fe None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.703586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 45/89] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:54.718604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79d43-9a2f-4815-a926-1a11b56d5300 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:54.718894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79d43-9a2f-4815-a926-1a11b56d5300 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:54.719175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d79d43-9a2f-4815-a926-1a11b56d5300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:54.745374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-03d79d43-9a2f-4815-a926-1a11b56d5300 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:54.746567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-03d79d43-9a2f-4815-a926-1a11b56d5300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:54.832707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 45/90] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:55.146283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412ea83-7b4f-4b51-a319-50deb1dfc1fe None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.233054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.256075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d79d43-9a2f-4815-a926-1a11b56d5300 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.289776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412ea83-7b4f-4b51-a319-50deb1dfc1fe None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.335058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841c62c-61ed-4291-8250-bf9eba0fe180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.335733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841c62c-61ed-4291-8250-bf9eba0fe180 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.336022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841c62c-61ed-4291-8250-bf9eba0fe180 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.336291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841c62c-61ed-4291-8250-bf9eba0fe180 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.363702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841c62c-61ed-4291-8250-bf9eba0fe180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-7841c62c-61ed-4291-8250-bf9eba0fe180 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:55.373411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:55.374307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:55.375078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:55.377978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 46/91] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:55.381019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216795a-ca19-4c7a-a1bb-910a9e444f6b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.381304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216795a-ca19-4c7a-a1bb-910a9e444f6b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.381582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216795a-ca19-4c7a-a1bb-910a9e444f6b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.386773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 47/92] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:55.387551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216795a-ca19-4c7a-a1bb-910a9e444f6b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.452358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d79d43-9a2f-4815-a926-1a11b56d5300 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.489941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010cd2d-4001-45f2-950f-cd72d73a7ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.490581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010cd2d-4001-45f2-950f-cd72d73a7ffb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.490913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010cd2d-4001-45f2-950f-cd72d73a7ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.491190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010cd2d-4001-45f2-950f-cd72d73a7ffb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.494083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.507618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6010cd2d-4001-45f2-950f-cd72d73a7ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6010cd2d-4001-45f2-950f-cd72d73a7ffb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:55.514481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:55.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:55.517043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 46/93] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:21:55.517672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1bd2-9b8d-4aed-8637-751ea6ba425e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.517672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1bd2-9b8d-4aed-8637-751ea6ba425e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.517784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1bd2-9b8d-4aed-8637-751ea6ba425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.540319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fcfc1bd2-9b8d-4aed-8637-751ea6ba425e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:55.542079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fcfc1bd2-9b8d-4aed-8637-751ea6ba425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:55.574858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216795a-ca19-4c7a-a1bb-910a9e444f6b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.600813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.626628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb1fe-12c6-4413-b6f2-76d42b9db7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.627230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb1fe-12c6-4413-b6f2-76d42b9db7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.627436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb1fe-12c6-4413-b6f2-76d42b9db7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.627702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb1fe-12c6-4413-b6f2-76d42b9db7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.628369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb1fe-12c6-4413-b6f2-76d42b9db7b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:55.628692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb1fe-12c6-4413-b6f2-76d42b9db7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:55.630064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb1fe-12c6-4413-b6f2-76d42b9db7b6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:55.632928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 47/94] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:55.634205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e293-d5f3-4b48-be79-84d98eb1a7ee None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.634490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e293-d5f3-4b48-be79-84d98eb1a7ee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.634764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e293-d5f3-4b48-be79-84d98eb1a7ee None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.636255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 48/95] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:55.636985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e293-d5f3-4b48-be79-84d98eb1a7ee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.643619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 48/96] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:55.645489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827526-a039-4574-a42d-b79679479306 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.645876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827526-a039-4574-a42d-b79679479306 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.646245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30827526-a039-4574-a42d-b79679479306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.671119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-30827526-a039-4574-a42d-b79679479306 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:55.672861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-30827526-a039-4574-a42d-b79679479306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:55.763880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 49/97] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:55.764916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827526-a039-4574-a42d-b79679479306 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.808670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e293-d5f3-4b48-be79-84d98eb1a7ee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.837137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.858999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.859687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.859963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.860235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.868557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:55.868557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:55.868557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:55.871222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 49/98] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:55.876856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:55.893825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30827526-a039-4574-a42d-b79679479306 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:55.913708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:55.943651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4978e53-c29c-4b6e-a8e7-1c32577b1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:55.944578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978e53-c29c-4b6e-a8e7-1c32577b1a74 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.945158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978e53-c29c-4b6e-a8e7-1c32577b1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.945807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4978e53-c29c-4b6e-a8e7-1c32577b1a74 None admin] PATH_INFO: `/v3/users/a24fab6fb50c48feb5ea274c9c664024` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.947410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4978e53-c29c-4b6e-a8e7-1c32577b1a74 None admin] RBAC: Authorizing `identity:get_user(user_id=a24fab6fb50c48feb5ea274c9c664024)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:55.949525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4978e53-c29c-4b6e-a8e7-1c32577b1a74 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:55.951593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 50/99] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/users/a24fab6fb50c48feb5ea274c9c664024 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:55.958295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d584cb-0ae3-451d-b977-6b36568457cb None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:55.958842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d584cb-0ae3-451d-b977-6b36568457cb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:55.959316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d584cb-0ae3-451d-b977-6b36568457cb None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:55.961431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 51/100] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:55.962322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d584cb-0ae3-451d-b977-6b36568457cb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.044670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f2762-1fd3-4761-aced-7302518eef9d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.084577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e852c1-2b7c-4f34-80c8-f5e85d21a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.085238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e852c1-2b7c-4f34-80c8-f5e85d21a9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.085522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e852c1-2b7c-4f34-80c8-f5e85d21a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.085796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e852c1-2b7c-4f34-80c8-f5e85d21a9c6 None admin] PATH_INFO: `/v3/users/a24fab6fb50c48feb5ea274c9c664024` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.087048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e852c1-2b7c-4f34-80c8-f5e85d21a9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=a24fab6fb50c48feb5ea274c9c664024)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.089015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d584cb-0ae3-451d-b977-6b36568457cb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.089160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e852c1-2b7c-4f34-80c8-f5e85d21a9c6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.091202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 50/101] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/users/a24fab6fb50c48feb5ea274c9c664024 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:56.093085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0230e2-875f-4a5a-8cb2-0360070ce2de None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.093085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0230e2-875f-4a5a-8cb2-0360070ce2de None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.093085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0230e2-875f-4a5a-8cb2-0360070ce2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.113689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fe0230e2-875f-4a5a-8cb2-0360070ce2de None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:56.120670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fe0230e2-875f-4a5a-8cb2-0360070ce2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:56.136462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.137833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.138616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.139417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.169850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.193444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.195136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 51/102] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:56.195973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0230e2-875f-4a5a-8cb2-0360070ce2de None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.214379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.215848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.310439 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0230e2-875f-4a5a-8cb2-0360070ce2de None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.315522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 52/103] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:21:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:21:56.317911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.347391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.348012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.348290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.348592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.359687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:56.364574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:56.365444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:56.366264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 52/104] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:56.366972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.404643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.414692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.435216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c2779-9ab7-406b-8253-a4f5d737e178 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.470909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4a019-cf22-4458-9f20-79d3a37e7148 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.476225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.476872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.477156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.477428 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.504334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2a95-ff94-4798-8775-51bd01d8d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.505001 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2a95-ff94-4798-8775-51bd01d8d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.505280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2a95-ff94-4798-8775-51bd01d8d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.505548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2a95-ff94-4798-8775-51bd01d8d1d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.506646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2a95-ff94-4798-8775-51bd01d8d1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.508082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2a95-ff94-4798-8775-51bd01d8d1d5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.509712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 53/105] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:56.512592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619afd-e6ab-48f4-9492-617953352e32 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.512592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619afd-e6ab-48f4-9492-617953352e32 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.512592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619afd-e6ab-48f4-9492-617953352e32 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.513225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 54/106] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:56.513916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619afd-e6ab-48f4-9492-617953352e32 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.547518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.549045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.614011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619afd-e6ab-48f4-9492-617953352e32 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.616495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.625649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.644520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 53/107] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:21:56.646673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.647301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.647582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.647855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.649151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.649360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.650427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.652556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 55/108] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:56.657316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.748401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa04878-de5f-4830-b64f-4be5d275b355 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.752525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adb006-c02c-4a51-bb25-dee60a8d4e18 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.781790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.782389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.782667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.782933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.783586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:56.783885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.785295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.785918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ec9b0-3078-4df2-93f5-892699c2516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.786535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ec9b0-3078-4df2-93f5-892699c2516f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.786813 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ec9b0-3078-4df2-93f5-892699c2516f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.787075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ec9b0-3078-4df2-93f5-892699c2516f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.793802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 54/109] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:56.794408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.798363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ec9b0-3078-4df2-93f5-892699c2516f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-957ec9b0-3078-4df2-93f5-892699c2516f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:56.803182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:56.804066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:21:56.804872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 56/110] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:56.805510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574dec6-cae9-4882-bdea-b23ec596ae0b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.806021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574dec6-cae9-4882-bdea-b23ec596ae0b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.806122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574dec6-cae9-4882-bdea-b23ec596ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.823405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5574dec6-cae9-4882-bdea-b23ec596ae0b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:56.824620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5574dec6-cae9-4882-bdea-b23ec596ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:56.837855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.851199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:56.890865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 57/111] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:56.891687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574dec6-cae9-4882-bdea-b23ec596ae0b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:56.893993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c6779-b89b-4b2a-a904-bb243baaf35c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:56.927945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:56.928496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:56.928778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:56.929047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:56.929683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:56.931145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:56.995659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574dec6-cae9-4882-bdea-b23ec596ae0b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.017396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 55/112] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:21:56 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:21:57.018199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.042385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.043318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.043739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.044155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.045868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.047703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.050602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 58/113] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:56 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.051943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.091569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.139380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.147990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b5ffd-5649-4341-a898-ba9004aa7f4a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.182402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0a7fa-3006-466d-9c1e-4bc4cf136b5b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.195165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.196386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.196844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.198117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.199018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] RBAC: Adding query filter params (role.id=781606224bfd4b6887aa0c545e3af45a, scope.project.id=34dde8575f264f5c8c8484f0d25a1802, user.id=a24fab6fb50c48feb5ea274c9c664024) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:57.199335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.200897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.207479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 56/114] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/role_assignments?user.id=a24fab6fb50c48feb5ea274c9c664024&scope.project.id=34dde8575f264f5c8c8484f0d25a1802&role.id=781606224bfd4b6887aa0c545e3af45a => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.208277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.225203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.225874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.226158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.226436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] PATH_INFO: `/v3/users/00eac5621d784a3eacee7e26efb73765` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.243639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=00eac5621d784a3eacee7e26efb73765)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.246246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.247775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 59/115] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/users/00eac5621d784a3eacee7e26efb73765 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.248823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.362318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bed75-e750-49ba-b93f-4672d934d2f9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.363848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.381380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf697-85de-4ad6-b6e3-cb1674e7f4d9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.415404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.416019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.416330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.416714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.417378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:57.417681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.419058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.428055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.428055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.428055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.428055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.428677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] RBAC: Adding query filter params (role.id=9633c4426fd245b7ad054ad7ca81ce1c, scope.project.id=34dde8575f264f5c8c8484f0d25a1802, user.id=a24fab6fb50c48feb5ea274c9c664024) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:57.429747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.430404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 57/116] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.430505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.432689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.444634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 60/117] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/role_assignments?user.id=a24fab6fb50c48feb5ea274c9c664024&scope.project.id=34dde8575f264f5c8c8484f0d25a1802&role.id=9633c4426fd245b7ad054ad7ca81ce1c => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.445569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.458731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.561633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec656bf-656b-450c-a293-f3855dd89ebb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.603397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.604831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.605113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.605430 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.617627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:21:57.619608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c6b52-5b49-418a-8d2f-c2b9840a311a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:21:57.623676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:21:57.624716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:21:57.625481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 58/118] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:21:57.629375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.671705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.672500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.672784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.673058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.678797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.678797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.678797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 61/119] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.678797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.702412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.738410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.757823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7797-ee7c-4161-895e-4d5600a57a1a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.796737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f002dff-64b0-42c5-bcbf-89e697387190 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.798334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.798966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.799254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.799519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] PATH_INFO: `/v3/users/c3037fdb5af64eb3a7204825aff76bfd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.800674 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] RBAC: Authorizing `identity:get_user(user_id=c3037fdb5af64eb3a7204825aff76bfd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.802160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.803748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 59/120] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/users/c3037fdb5af64eb3a7204825aff76bfd => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.804508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.837546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.839077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.839371 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.839936 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.840642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:57.841093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.842503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.857911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 62/121] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:57.857911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:57.910142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3e081-49ae-4e4e-9b1a-3d3f26cae349 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:57.944939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:57.945694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:57.945987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:57.946246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/00eac5621d784a3eacee7e26efb73765/roles/4e42596f37da423aace7e51d7dd1b97c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:57.948272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:57.949261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] RBAC: Authorizing `identity:create_grant(project_id=34dde8575f264f5c8c8484f0d25a1802, user_id=00eac5621d784a3eacee7e26efb73765, role_id=4e42596f37da423aace7e51d7dd1b97c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:57.950690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:57.967269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620ba1-8e23-4feb-9d48-54c27d842e73 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:58.000854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:58.001469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:58.001752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:58.002025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:58.011968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 60/122] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:21:57 2022] PUT /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802/users/00eac5621d784a3eacee7e26efb73765/roles/4e42596f37da423aace7e51d7dd1b97c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:21:58.013173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:58.028348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:58.114397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:58.116192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:58.144777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0827-d527-4e08-8b30-f58557f0c761 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:58.187386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:58.188410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:58.188932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:58.189475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] PATH_INFO: `/v3/users/a24fab6fb50c48feb5ea274c9c664024` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:58.190844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] RBAC: Authorizing `identity:get_user(user_id=a24fab6fb50c48feb5ea274c9c664024)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:58.193399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:58.195584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 61/123] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:21:58 2022] GET /identity/v3/users/a24fab6fb50c48feb5ea274c9c664024 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:58.201350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:58.224607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:58.243115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 63/124] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:21:58.250618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:58.290852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:58.321137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d32c5-a877-4054-bdf0-6f0164443f37 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:58.372352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f6db-3a8a-45cc-92a4-15e7495b1d92 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:58.372554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:58.373117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:58.373403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:58.373703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:58.418574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:58.419265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:58.419552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:58.419828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:58.421271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:58.423759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:58.425460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 64/125] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:58 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:58.431273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:58.460695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:58.462328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:58.484769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:58.538735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b55b24-5434-4f51-ad74-acf74208e5ad None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:58.544619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:58.569017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 62/126] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:21:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:21:58.574808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:58.580669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:58.581459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:58.581885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:58.582300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:58.584225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=34dde8575f264f5c8c8484f0d25a1802, user.id=c3037fdb5af64eb3a7204825aff76bfd) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:58.584743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:58.586827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:58.594957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 65/127] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:21:58 2022] GET /identity/v3/role_assignments?user.id=c3037fdb5af64eb3a7204825aff76bfd&scope.project.id=34dde8575f264f5c8c8484f0d25a1802&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:58.689101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f3884-d553-4383-a318-e6b6580b7fd2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:58.727857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c57f1-fbce-44b7-9c66-f96ad7f273b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:58.729062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c57f1-fbce-44b7-9c66-f96ad7f273b9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:58.729355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c57f1-fbce-44b7-9c66-f96ad7f273b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:58.729630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c57f1-fbce-44b7-9c66-f96ad7f273b9 None admin] PATH_INFO: `/v3/projects/22fa3c28f6ee4103b6ffeb0861df03ee` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:58.730797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c57f1-fbce-44b7-9c66-f96ad7f273b9 None admin] RBAC: Authorizing `identity:get_project(project_id=22fa3c28f6ee4103b6ffeb0861df03ee)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:58.732280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c57f1-fbce-44b7-9c66-f96ad7f273b9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:58.739026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 63/128] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:21:58 2022] GET /identity/v3/projects/22fa3c28f6ee4103b6ffeb0861df03ee => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:21:58.740388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:58.850818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01c2eb-d93a-415f-ab97-623a5de80395 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:58.866274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:58.887521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740479ad-7223-4eeb-b98b-16b5e7c1c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:58.888647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740479ad-7223-4eeb-b98b-16b5e7c1c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:58.889130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740479ad-7223-4eeb-b98b-16b5e7c1c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:58.889601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740479ad-7223-4eeb-b98b-16b5e7c1c7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:58.890527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740479ad-7223-4eeb-b98b-16b5e7c1c7c5 None admin] RBAC: Adding query filter params (role.id=781606224bfd4b6887aa0c545e3af45a, scope.project.id=22fa3c28f6ee4103b6ffeb0861df03ee, user.id=a24fab6fb50c48feb5ea274c9c664024) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:21:58.891034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740479ad-7223-4eeb-b98b-16b5e7c1c7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:58.892742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740479ad-7223-4eeb-b98b-16b5e7c1c7c5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:58.899059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 66/129] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:21:58 2022] GET /identity/v3/role_assignments?user.id=a24fab6fb50c48feb5ea274c9c664024&scope.project.id=22fa3c28f6ee4103b6ffeb0861df03ee&role.id=781606224bfd4b6887aa0c545e3af45a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:59.311130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950a44-f279-42c2-819d-c7ecc1725061 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.311412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950a44-f279-42c2-819d-c7ecc1725061 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.311698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950a44-f279-42c2-819d-c7ecc1725061 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.313132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 64/130] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:21:59.318463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982d268-35aa-419c-b3e7-38aa67346a85 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.318818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982d268-35aa-419c-b3e7-38aa67346a85 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.319161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982d268-35aa-419c-b3e7-38aa67346a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.338895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6982d268-35aa-419c-b3e7-38aa67346a85 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:21:59.340069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6982d268-35aa-419c-b3e7-38aa67346a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:21:59.405567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 67/131] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:21:59.673796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe950a44-f279-42c2-819d-c7ecc1725061 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:59.719789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:59.772921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe950a44-f279-42c2-819d-c7ecc1725061 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:59.805786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e2a94-b74f-44ab-b0f3-32fafd6543cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:59.806413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e2a94-b74f-44ab-b0f3-32fafd6543cf None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.807232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e2a94-b74f-44ab-b0f3-32fafd6543cf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.807502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e2a94-b74f-44ab-b0f3-32fafd6543cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.808625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e2a94-b74f-44ab-b0f3-32fafd6543cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:59.810061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e2a94-b74f-44ab-b0f3-32fafd6543cf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:21:59.811626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 65/132] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:21:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:21:59.817300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982d268-35aa-419c-b3e7-38aa67346a85 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:21:59.913550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982d268-35aa-419c-b3e7-38aa67346a85 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:21:59.922583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:21:59.946740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c3838-c15c-412a-9f4a-104f1a0d928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:21:59.947838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3838-c15c-412a-9f4a-104f1a0d928a None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:21:59.948123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3838-c15c-412a-9f4a-104f1a0d928a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:21:59.948394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3838-c15c-412a-9f4a-104f1a0d928a None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:21:59.949068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3838-c15c-412a-9f4a-104f1a0d928a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:21:59.950604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c3838-c15c-412a-9f4a-104f1a0d928a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:00.043026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 68/133] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:21:59 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:00.245989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6787-ded2-4c6f-86fd-0493faace399 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:00.246203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6787-ded2-4c6f-86fd-0493faace399 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:00.246479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6787-ded2-4c6f-86fd-0493faace399 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:00.247824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 66/134] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:00.253396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f9b10-5c02-46f3-b8da-249f348b4a4c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:00.253684 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f9b10-5c02-46f3-b8da-249f348b4a4c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:00.253962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f9b10-5c02-46f3-b8da-249f348b4a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:00.272022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cb1f9b10-5c02-46f3-b8da-249f348b4a4c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:00.273243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cb1f9b10-5c02-46f3-b8da-249f348b4a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:00.343519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 69/135] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:00.612238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6787-ded2-4c6f-86fd-0493faace399 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:00.719429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6787-ded2-4c6f-86fd-0493faace399 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:00.733159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:00.754409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:00.755041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:00.755320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:00.755593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:00.766826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:00.771717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:00.772602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:00.773458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 67/136] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:00.779421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f9b10-5c02-46f3-b8da-249f348b4a4c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:00.876980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:00.882108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f9b10-5c02-46f3-b8da-249f348b4a4c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:00.917482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:00.918100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:00.918379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:00.918651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:00.919317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:00.919616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:00.921025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:00.929944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 70/137] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:00.935454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:01.049930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79731e-f5ff-40c8-9661-ff91c4ead34e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:01.085945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:01.086579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:01.086861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:01.087133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] PATH_INFO: `/v3/users/00eac5621d784a3eacee7e26efb73765` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:01.088301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] RBAC: Authorizing `identity:get_user(user_id=00eac5621d784a3eacee7e26efb73765)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:01.089782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:01.091539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 68/138] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:00 2022] GET /identity/v3/users/00eac5621d784a3eacee7e26efb73765 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:01.096987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:01.209277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702edb-c0d6-426f-9f1f-0440862243f7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:01.243514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:01.244883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:01.245174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:01.245452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:01.272097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:01.317933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:01.319428 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:01.419434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 71/139] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:01.425066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:01.467777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:01.531159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fe676-f716-47ff-9ee6-89fc9ac62916 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:01.567296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592de86-70ee-4fb0-8b58-ed089b584782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:01.567933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592de86-70ee-4fb0-8b58-ed089b584782 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:01.568213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592de86-70ee-4fb0-8b58-ed089b584782 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:01.568513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592de86-70ee-4fb0-8b58-ed089b584782 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:01.569648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592de86-70ee-4fb0-8b58-ed089b584782 None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:01.571173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592de86-70ee-4fb0-8b58-ed089b584782 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:01.573191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 69/140] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:01 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:01.581532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:01.640140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:01.685973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bafa8-65cb-41cb-9425-cc357220b0a5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:01.720184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d00a8-54a8-46b3-9337-700517db9866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:01.720749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d00a8-54a8-46b3-9337-700517db9866 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:01.721032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d00a8-54a8-46b3-9337-700517db9866 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:01.721309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d00a8-54a8-46b3-9337-700517db9866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:01.722102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d00a8-54a8-46b3-9337-700517db9866 None admin] RBAC: Adding query filter params (role.id=4e42596f37da423aace7e51d7dd1b97c, scope.project.id=34dde8575f264f5c8c8484f0d25a1802, user.id=00eac5621d784a3eacee7e26efb73765) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:01.722414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d00a8-54a8-46b3-9337-700517db9866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:01.723853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d00a8-54a8-46b3-9337-700517db9866 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:01.730540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 72/141] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:01 2022] GET /identity/v3/role_assignments?user.id=00eac5621d784a3eacee7e26efb73765&scope.project.id=34dde8575f264f5c8c8484f0d25a1802&role.id=4e42596f37da423aace7e51d7dd1b97c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:02.339273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694a3d-cb75-469d-8221-bad7ddcd2f09 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.339799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694a3d-cb75-469d-8221-bad7ddcd2f09 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.339799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f694a3d-cb75-469d-8221-bad7ddcd2f09 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.341215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 70/142] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:02.346218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c553ba-43de-4679-9048-742df0aa80f4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.346677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c553ba-43de-4679-9048-742df0aa80f4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.346949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c553ba-43de-4679-9048-742df0aa80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.365278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-71c553ba-43de-4679-9048-742df0aa80f4 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:02.366465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-71c553ba-43de-4679-9048-742df0aa80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:02.440539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 73/143] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:02.506945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8709-b4c7-4566-97e8-16838d00ee37 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.507245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8709-b4c7-4566-97e8-16838d00ee37 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.507521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8709-b4c7-4566-97e8-16838d00ee37 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.509031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 71/144] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:02.514561 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565654-1afe-46a7-840b-8e5c6385a217 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.514865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565654-1afe-46a7-840b-8e5c6385a217 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.515141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565654-1afe-46a7-840b-8e5c6385a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.533656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-97565654-1afe-46a7-840b-8e5c6385a217 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:02.534821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-97565654-1afe-46a7-840b-8e5c6385a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:02.579488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf9c5-e2d8-4724-868f-2627b4f23e60 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.579788 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf9c5-e2d8-4724-868f-2627b4f23e60 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.580044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf9c5-e2d8-4724-868f-2627b4f23e60 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.581430 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 72/145] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:02.583267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:02.586248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8a99e-18b7-4c59-b179-823480780c0a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.586529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8a99e-18b7-4c59-b179-823480780c0a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.586803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8a99e-18b7-4c59-b179-823480780c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.604632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 74/146] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:02.608693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-afa8a99e-18b7-4c59-b179-823480780c0a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:02.608693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-afa8a99e-18b7-4c59-b179-823480780c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:02.676716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 73/147] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:02.710917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565654-1afe-46a7-840b-8e5c6385a217 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:02.809149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565654-1afe-46a7-840b-8e5c6385a217 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:02.841870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:02.842484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:02.842757 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:02.843030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:02.852870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:02.857704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:02.858800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:02.859682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:02.863575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 75/148] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:02.864422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8a99e-18b7-4c59-b179-823480780c0a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:02.875157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:02.909247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:02.924602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:02.972936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8a99e-18b7-4c59-b179-823480780c0a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:02.983275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0c0ab-990b-4f95-b794-ebf214cb5d29 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.008327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.008975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.009256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.009527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.010220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:03.010524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.011896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.020030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.020681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.020961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.021063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 74/149] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:03.021239 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.021772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.032394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:03.037223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:03.038375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:03.039372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 76/150] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:03.041782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.122657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:03.125542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19cf20-3e1c-4d6a-ad4f-c649c9681a24 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.137689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:03.140505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76600-3f92-4d39-b0c7-3868573c596a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.159657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.163791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.163791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.163791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.163791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.163791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.164970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 75/151] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:03.165720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.174132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.174756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.175030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.175428 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] PATH_INFO: `/v3/users/c6b32c34b13c4391b09c61b51d59416f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.189567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] RBAC: Authorizing `identity:get_user(user_id=c6b32c34b13c4391b09c61b51d59416f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.191024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.192654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 77/152] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:03 2022] GET /identity/v3/users/c6b32c34b13c4391b09c61b51d59416f => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:03.197266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.264216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880b571-20a2-4691-b0c3-5ff0d1b1f918 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.293237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c7068-3fc2-43e5-9fca-045d1267fb7d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.296466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.297062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.297338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.297602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.298252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:03.298549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.299910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.308106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 76/153] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:03.312863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.325449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.326051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.326326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.326589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.327358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.328800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.341865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:03.408202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d29a5c-5efa-4bd5-92be-b5ae2690c4fb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.424491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 78/154] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:03 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:03.424491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.430718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:03.447977 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.448663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.448942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.449210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.450402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.451885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.453832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 77/155] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:03 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:03.459411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.532754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db53ea-f331-486f-8cdd-89ac034dafc6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.564368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:03.568306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b8402-7459-40d4-993f-edd85693c5f7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.571494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.572177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.572470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.572748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] PATH_INFO: `/v3/users/c6b32c34b13c4391b09c61b51d59416f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.573930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] RBAC: Authorizing `identity:get_user(user_id=c6b32c34b13c4391b09c61b51d59416f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.578869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.578869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 79/156] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:03 2022] GET /identity/v3/users/c6b32c34b13c4391b09c61b51d59416f => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:03.583635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.606766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.607546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.608023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.608520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/c6b32c34b13c4391b09c61b51d59416f/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.611141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] RBAC: Authorizing `identity:create_grant(project_id=92d6c8b711fa4a978e3fd79ba5858acd, user_id=c6b32c34b13c4391b09c61b51d59416f, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.612799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.676590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:03.693238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91dbd4-e70f-4d9f-b131-7bdc4d310600 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.701693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 78/157] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:03 2022] PUT /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/c6b32c34b13c4391b09c61b51d59416f/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:22:03.736252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575ffdf-25e3-4915-93db-99850f38364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.736982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575ffdf-25e3-4915-93db-99850f38364f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.737260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575ffdf-25e3-4915-93db-99850f38364f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.737530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575ffdf-25e3-4915-93db-99850f38364f None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.738740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575ffdf-25e3-4915-93db-99850f38364f None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.740246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575ffdf-25e3-4915-93db-99850f38364f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.742419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 80/158] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:03 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:03.748405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:03.867214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743ed4d-1433-4060-89ee-097c3393326a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:03.904100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a44693-062e-47e2-a88a-03fcd8311a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:03.904824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44693-062e-47e2-a88a-03fcd8311a08 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:03.905102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44693-062e-47e2-a88a-03fcd8311a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:03.905370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a44693-062e-47e2-a88a-03fcd8311a08 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/c6b32c34b13c4391b09c61b51d59416f/roles/9633c4426fd245b7ad054ad7ca81ce1c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:03.907892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a44693-062e-47e2-a88a-03fcd8311a08 None admin] RBAC: Authorizing `identity:create_grant(project_id=92d6c8b711fa4a978e3fd79ba5858acd, user_id=c6b32c34b13c4391b09c61b51d59416f, role_id=9633c4426fd245b7ad054ad7ca81ce1c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:03.909464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a44693-062e-47e2-a88a-03fcd8311a08 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:03.970455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 79/159] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:03 2022] PUT /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/c6b32c34b13c4391b09c61b51d59416f/roles/9633c4426fd245b7ad054ad7ca81ce1c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:05.727275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5802-c52c-4be3-ba82-c0b538aba7ea None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:05.727802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5802-c52c-4be3-ba82-c0b538aba7ea None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:05.727802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5802-c52c-4be3-ba82-c0b538aba7ea None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:05.729242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 81/160] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:05.734631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606d8dd-7d4a-4d36-8f2b-0bf5bea3c1cf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:05.735045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606d8dd-7d4a-4d36-8f2b-0bf5bea3c1cf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:05.735191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606d8dd-7d4a-4d36-8f2b-0bf5bea3c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:05.754557 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1606d8dd-7d4a-4d36-8f2b-0bf5bea3c1cf None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:05.755758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1606d8dd-7d4a-4d36-8f2b-0bf5bea3c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:05.770260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:05.824831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11a68-2d37-4431-8c2a-7ef8c43c35b6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:05.825114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11a68-2d37-4431-8c2a-7ef8c43c35b6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:05.825380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11a68-2d37-4431-8c2a-7ef8c43c35b6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:05.826865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 82/161] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:05.831796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a4c9-f076-4adf-8bc1-6ea0729128ce None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:05.832084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a4c9-f076-4adf-8bc1-6ea0729128ce None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:05.832368 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a4c9-f076-4adf-8bc1-6ea0729128ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:05.833828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 80/162] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:05.852191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-11c4a4c9-f076-4adf-8bc1-6ea0729128ce None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:05.853697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-11c4a4c9-f076-4adf-8bc1-6ea0729128ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:05.907261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcfc14-8266-4344-acd4-b0b6580f7f81 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:05.907843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcfc14-8266-4344-acd4-b0b6580f7f81 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:05.908483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcfc14-8266-4344-acd4-b0b6580f7f81 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:05.910346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 81/163] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:05.916664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ce53-6dac-4c94-af82-6009609763c7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:05.917165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ce53-6dac-4c94-af82-6009609763c7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:05.917652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8ce53-6dac-4c94-af82-6009609763c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:05.927968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 83/164] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:05.936734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c1e8ce53-6dac-4c94-af82-6009609763c7 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:05.938103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c1e8ce53-6dac-4c94-af82-6009609763c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:06.008214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 82/165] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:06.104423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a4c9-f076-4adf-8bc1-6ea0729128ce None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.169980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07a30-1ac3-4260-ab60-8971e616508e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.170413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07a30-1ac3-4260-ab60-8971e616508e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.170944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07a30-1ac3-4260-ab60-8971e616508e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.172584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 83/166] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:06.177583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dbfbf-71b5-447d-bffd-2867fcecf854 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.178090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dbfbf-71b5-447d-bffd-2867fcecf854 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.178618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dbfbf-71b5-447d-bffd-2867fcecf854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.201381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-416dbfbf-71b5-447d-bffd-2867fcecf854 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:06.201596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.203342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-416dbfbf-71b5-447d-bffd-2867fcecf854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:06.221531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a4c9-f076-4adf-8bc1-6ea0729128ce None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.302851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 84/167] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:06.305151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.305359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dbfbf-71b5-447d-bffd-2867fcecf854 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.305898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.306226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.307139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.315786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.320143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:06.326901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:06.328185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:06.329181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.415659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dbfbf-71b5-447d-bffd-2867fcecf854 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.434499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daf9e0-eb56-4193-ab9d-dc1639f5592f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.451357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.451978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.452458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.452747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.453834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:06.455315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:06.456968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 85/169] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:06.457813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.474092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.474772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.475054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.475323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.484215 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.487925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:06.492885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:06.495762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 85/170] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:06.496603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.543710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.568284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042ae0c-1f4a-4e0d-b9d2-fe69939c0279 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.601929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3ddbb-5eef-4028-93f4-aff03fc3e082 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.605473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.606067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.606341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.606609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.607615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:06.607926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:06.609314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:06.617308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 86/171] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:06.617308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.638584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.639185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.639457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.639723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.640368 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:06.641839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:06.715053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb77bb-5239-4659-8c38-0552b9c06faa None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.746803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.747394 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.747672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.747943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.748631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:06.748932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:06.750292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:06.753295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 86/172] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:06 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:06.755392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.757428 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.761097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 87/173] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:06.761989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.825085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:06.875029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc7898-e210-4b56-a3c9-9cb29b23fadd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.875284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbda75-ccee-4d56-a4f9-5abed6e335b2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:06.913586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.914232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.914510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.914788 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] PATH_INFO: `/v3/users/e2ece35612e8430ab30d9d0f2d50918c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.916187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:06.916874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:06.917156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:06.917425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:06.928115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:06.930522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ece35612e8430ab30d9d0f2d50918c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:06.932013 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:06.933486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:06.934404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:06.935201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:06.935809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 88/174] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/users/e2ece35612e8430ab30d9d0f2d50918c => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:06.935809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:06.935939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 87/175] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:06.942219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.007461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.062859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaecf7b-cbae-4be8-a38f-9c1998774098 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.073135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d007a8-1ba2-4b3a-b8c0-489bbbc6fc55 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.094036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.111764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.111959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.112478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.112608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.112766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.112876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.113089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] PATH_INFO: `/v3/users/c6b32c34b13c4391b09c61b51d59416f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.113186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.114267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=c6b32c34b13c4391b09c61b51d59416f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.114381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.116169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.116768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.117851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 89/176] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/users/c6b32c34b13c4391b09c61b51d59416f => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.118629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.119608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 88/177] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:06 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.125569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.250751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5e00f-369c-47ff-84d6-da94b9fd1f78 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.281169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e89ed-dfbe-491a-8301-db31db60c1a2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.285528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.286139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.286412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.286677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.310657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.320839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.321542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.326961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.326961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.326961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:07.326961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.326961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.334242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 90/178] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.335051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.352663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.371011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.373086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.448197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fabfe6-d85e-4934-9075-af123785048b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.485172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.485669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 89/179] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:07.485914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.486124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.486406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/e2ece35612e8430ab30d9d0f2d50918c/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.488623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] RBAC: Authorizing `identity:create_grant(project_id=92d6c8b711fa4a978e3fd79ba5858acd, user_id=e2ece35612e8430ab30d9d0f2d50918c, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.490322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.491004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.565899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 91/180] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:07 2022] PUT /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/e2ece35612e8430ab30d9d0f2d50918c/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:07.569326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.591427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.623458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fd59c-c6bc-4bdd-b5bf-53febd6b7594 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.676147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.693836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.694486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.694760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.696968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] PATH_INFO: `/v3/users/c6b32c34b13c4391b09c61b51d59416f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.697074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] RBAC: Authorizing `identity:get_user(user_id=c6b32c34b13c4391b09c61b51d59416f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.698507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.700491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 90/181] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/users/c6b32c34b13c4391b09c61b51d59416f => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.707346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.799415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecc688-a0df-4599-83f6-cbe1e045e314 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.838470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.839107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.839384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.839653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.841012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.845760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:07.848039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 92/182] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:07.857450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:07.872362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ced79-1b78-4ec6-95b4-d5ce093a5a24 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:07.914972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:07.916943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:07.917779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:07.918544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:07.942330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:07.995278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:07.997588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.021567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7933c-907c-490b-ac33-566203550e18 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.069665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:08.109614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 91/183] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:08.118906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.121079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.121693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.121967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.122233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.122963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd, user.id=c6b32c34b13c4391b09c61b51d59416f) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:08.123265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.129232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.138363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 93/184] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:07 2022] GET /identity/v3/role_assignments?user.id=c6b32c34b13c4391b09c61b51d59416f&scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:08.200937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:08.269946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784b2af-dd58-4ad1-ac30-d0a846683802 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.319620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aef1c-eb35-4058-918f-cb60decc427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.320695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aef1c-eb35-4058-918f-cb60decc427c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.321193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aef1c-eb35-4058-918f-cb60decc427c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.321663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aef1c-eb35-4058-918f-cb60decc427c None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.323672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aef1c-eb35-4058-918f-cb60decc427c None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.325396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aef1c-eb35-4058-918f-cb60decc427c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.327347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 92/185] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:08 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:08.333596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:08.456191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297aa5b-23f9-47b5-ab32-383c0203e75e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:08.493426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fab22-a7f3-4e77-b773-77b8511b3660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:08.494063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fab22-a7f3-4e77-b773-77b8511b3660 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:08.494341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fab22-a7f3-4e77-b773-77b8511b3660 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:08.494611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fab22-a7f3-4e77-b773-77b8511b3660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:08.495331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fab22-a7f3-4e77-b773-77b8511b3660 None admin] RBAC: Adding query filter params (role.id=9633c4426fd245b7ad054ad7ca81ce1c, scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd, user.id=c6b32c34b13c4391b09c61b51d59416f) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:08.495634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fab22-a7f3-4e77-b773-77b8511b3660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:08.497106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fab22-a7f3-4e77-b773-77b8511b3660 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:08.503378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 94/186] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:08 2022] GET /identity/v3/role_assignments?user.id=c6b32c34b13c4391b09c61b51d59416f&scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd&role.id=9633c4426fd245b7ad054ad7ca81ce1c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:09.221295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aba14-649b-4934-a037-d35f19b3305d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.221800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aba14-649b-4934-a037-d35f19b3305d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.221904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aba14-649b-4934-a037-d35f19b3305d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.223299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 93/187] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:09.228850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5ee5-99f0-466f-b3bd-0a255591fe27 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.229262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5ee5-99f0-466f-b3bd-0a255591fe27 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.229461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad5ee5-99f0-466f-b3bd-0a255591fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.247893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e6ad5ee5-99f0-466f-b3bd-0a255591fe27 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:09.249076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e6ad5ee5-99f0-466f-b3bd-0a255591fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:09.268471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14f597-6c0f-495d-afe7-f9c7a26b8794 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.268958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14f597-6c0f-495d-afe7-f9c7a26b8794 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.269781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14f597-6c0f-495d-afe7-f9c7a26b8794 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.271253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 94/188] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:09.276492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035aa8-e833-4bd9-91b2-27d901f2451e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.276781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035aa8-e833-4bd9-91b2-27d901f2451e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.277054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90035aa8-e833-4bd9-91b2-27d901f2451e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.290416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:09.296390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-90035aa8-e833-4bd9-91b2-27d901f2451e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:09.297600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-90035aa8-e833-4bd9-91b2-27d901f2451e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:09.318061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 95/189] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:09.366672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 95/190] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:09.585585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5ee5-99f0-466f-b3bd-0a255591fe27 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:09.641336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035aa8-e833-4bd9-91b2-27d901f2451e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:09.689269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad5ee5-99f0-466f-b3bd-0a255591fe27 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:09.693871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:09.724089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:09.724744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.725018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.725286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.736754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:09.741507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:09.742564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:09.743480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 96/191] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:09.748820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:09.754619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90035aa8-e833-4bd9-91b2-27d901f2451e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:09.785531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:09.788763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:09.789391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.789660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.789925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.791902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:09.793378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:09.796611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:09.800317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:09.854089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2832c33-e11f-4394-96cb-19626cdc25d4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:09.890980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:09.891584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.891856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.892113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.892813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:09.893107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:09.894474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:09.902605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 97/193] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:09.908275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:09.912887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bb2f1-7552-4e80-b6ae-e66547059bfe None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:09.936731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:09.955983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cbbe0-6718-4b5b-876c-6d43a7cf2dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:09.956890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cbbe0-6718-4b5b-876c-6d43a7cf2dd3 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:09.957303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cbbe0-6718-4b5b-876c-6d43a7cf2dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:09.957866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cbbe0-6718-4b5b-876c-6d43a7cf2dd3 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:09.958792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cbbe0-6718-4b5b-876c-6d43a7cf2dd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:09.960271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cbbe0-6718-4b5b-876c-6d43a7cf2dd3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:10.007484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:10.013016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c9f56-9298-4620-8f01-42f16883d485 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:10.045425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d6e42-cdd4-4bbb-b339-023c38d433d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:10.046097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d6e42-cdd4-4bbb-b339-023c38d433d6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.046311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d6e42-cdd4-4bbb-b339-023c38d433d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.046570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d6e42-cdd4-4bbb-b339-023c38d433d6 None admin] PATH_INFO: `/v3/users/6f54cea7bc504f9d878572b5aa717cef` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.059985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d6e42-cdd4-4bbb-b339-023c38d433d6 None admin] RBAC: Authorizing `identity:get_user(user_id=6f54cea7bc504f9d878572b5aa717cef)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:10.061462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d6e42-cdd4-4bbb-b339-023c38d433d6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:10.063079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 98/194] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:09 2022] GET /identity/v3/users/6f54cea7bc504f9d878572b5aa717cef => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:10.065714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3184-751f-4af3-99c6-d82637aea14f None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.066043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3184-751f-4af3-99c6-d82637aea14f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.066362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3184-751f-4af3-99c6-d82637aea14f None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.067580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 99/195] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:10.068268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3184-751f-4af3-99c6-d82637aea14f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:10.075686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 97/196] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:09 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:22:10.075686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73b2d1-b3fc-4dc3-a36a-416229696e9f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.075686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73b2d1-b3fc-4dc3-a36a-416229696e9f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.075686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73b2d1-b3fc-4dc3-a36a-416229696e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.097270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0f73b2d1-b3fc-4dc3-a36a-416229696e9f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:10.098497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f73b2d1-b3fc-4dc3-a36a-416229696e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:10.185502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 98/197] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:10.197383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3184-751f-4af3-99c6-d82637aea14f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:10.235385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:10.236019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.236272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.236572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.237691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:10.239123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:10.240958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 100/198] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:10 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:10.247040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73b2d1-b3fc-4dc3-a36a-416229696e9f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:10.351593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73b2d1-b3fc-4dc3-a36a-416229696e9f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:10.354077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:10.388283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:10.388893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.389166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.389435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/6f54cea7bc504f9d878572b5aa717cef/roles/4e42596f37da423aace7e51d7dd1b97c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.391414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] RBAC: Authorizing `identity:create_grant(project_id=92d6c8b711fa4a978e3fd79ba5858acd, user_id=6f54cea7bc504f9d878572b5aa717cef, role_id=4e42596f37da423aace7e51d7dd1b97c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:10.392924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:10.457622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:10.474594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 99/199] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:10 2022] PUT /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/users/6f54cea7bc504f9d878572b5aa717cef/roles/4e42596f37da423aace7e51d7dd1b97c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:10.485240 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:10.579783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33036-cd29-496f-abd8-bcba0a4a33ff None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:10.618115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:10.619419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.619729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.619998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.632001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:10.637119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:10.638050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:10.639359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 101/200] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:10.646512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:10.756977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36a014-364b-49c9-9065-1ffc296dc229 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:10.792593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:10.793302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.793574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.793838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.794547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:10.794847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:10.796221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:10.805177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:10.811525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:10.901011 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:10.919827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476c741-0d8c-4c06-a472-ec46d183c721 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:10.954763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:10.955392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:10.955664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:10.955928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] PATH_INFO: `/v3/users/e2ece35612e8430ab30d9d0f2d50918c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:10.957063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] RBAC: Authorizing `identity:get_user(user_id=e2ece35612e8430ab30d9d0f2d50918c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:10.958509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:10.960294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 102/202] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:10 2022] GET /identity/v3/users/e2ece35612e8430ab30d9d0f2d50918c => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:10.966528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:10.997548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:11.080058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56618718-2c31-42e4-b315-72ba83effbaf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:11.118352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:11.118352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.118352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.118352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.194173 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:11.195613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:11.241161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:11.300441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 101/203] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:11.306039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:11.407553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200d7f-cd64-48f1-a1dc-597fca6e5cce None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:11.444383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1e5a0-8fef-48eb-a4e1-c6ded3f472f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:11.444960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1e5a0-8fef-48eb-a4e1-c6ded3f472f2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.445233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1e5a0-8fef-48eb-a4e1-c6ded3f472f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.445500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1e5a0-8fef-48eb-a4e1-c6ded3f472f2 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.446610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1e5a0-8fef-48eb-a4e1-c6ded3f472f2 None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:11.448606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1e5a0-8fef-48eb-a4e1-c6ded3f472f2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:11.450532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 103/204] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:11 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:11.456357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:11.556727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb4547-0dc7-4b1a-bdcd-76fa09016aca None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:11.584781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:11.591764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2cc3c-02fe-4e46-802f-c2e16b75be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:11.592365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cc3c-02fe-4e46-802f-c2e16b75be36 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:11.592679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cc3c-02fe-4e46-802f-c2e16b75be36 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:11.592992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cc3c-02fe-4e46-802f-c2e16b75be36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:11.593774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2cc3c-02fe-4e46-802f-c2e16b75be36 None admin] RBAC: Adding query filter params (role.id=781606224bfd4b6887aa0c545e3af45a, scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd, user.id=e2ece35612e8430ab30d9d0f2d50918c) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:11.594077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2cc3c-02fe-4e46-802f-c2e16b75be36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:11.595500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2cc3c-02fe-4e46-802f-c2e16b75be36 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:11.601249 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 102/205] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:11 2022] GET /identity/v3/role_assignments?user.id=e2ece35612e8430ab30d9d0f2d50918c&scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd&role.id=781606224bfd4b6887aa0c545e3af45a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:12.445436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51c623-358b-4f14-a18d-46a994cdaee2 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.445938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51c623-358b-4f14-a18d-46a994cdaee2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.445938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51c623-358b-4f14-a18d-46a994cdaee2 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.447425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 104/206] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:12.452550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256dd5-90f8-4262-9a02-631ca1830937 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.452962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256dd5-90f8-4262-9a02-631ca1830937 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.453124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f256dd5-90f8-4262-9a02-631ca1830937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.471716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5f256dd5-90f8-4262-9a02-631ca1830937 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:12.472903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5f256dd5-90f8-4262-9a02-631ca1830937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:12.477650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488126-cb92-45e6-95f0-2ff1a1edd69c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.478494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488126-cb92-45e6-95f0-2ff1a1edd69c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.478773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488126-cb92-45e6-95f0-2ff1a1edd69c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.480300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 105/207] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:12.485743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09a00-3e01-4282-835a-96508cf94229 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.486119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09a00-3e01-4282-835a-96508cf94229 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.486405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f09a00-3e01-4282-835a-96508cf94229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.504489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-25f09a00-3e01-4282-835a-96508cf94229 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:12.505652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-25f09a00-3e01-4282-835a-96508cf94229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:12.519353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.552447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 103/208] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:12.584572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 106/209] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:12.716608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a39b-9930-4720-8929-1bf4f8954b84 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.716814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a39b-9930-4720-8929-1bf4f8954b84 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.717262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a39b-9930-4720-8929-1bf4f8954b84 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.718738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 104/210] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:12.723633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c0b3-4598-4d0a-af56-d953bfb4f8e0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.723912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c0b3-4598-4d0a-af56-d953bfb4f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.724178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37c0b3-4598-4d0a-af56-d953bfb4f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.741897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dc37c0b3-4598-4d0a-af56-d953bfb4f8e0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:12.743065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dc37c0b3-4598-4d0a-af56-d953bfb4f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:12.810102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 107/211] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:12.823770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a39b-9930-4720-8929-1bf4f8954b84 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.859463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37c0b3-4598-4d0a-af56-d953bfb4f8e0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.938669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.939726 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a39b-9930-4720-8929-1bf4f8954b84 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.959940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37c0b3-4598-4d0a-af56-d953bfb4f8e0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:12.960666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:12.975729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.976292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.976594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.976861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:12.978024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:12.979711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:12.981532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 105/212] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:12.986775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:12.995559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:12.996211 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:12.996520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:12.996807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.006889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:13.012258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:13.013272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:13.017539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 108/213] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:13.018987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.099739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b42d4-2958-4c5c-8087-30bff004470d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.129271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd2825-1127-486f-a9a1-3a506bfaf041 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.136058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.136697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.136980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.137250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.137897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.139333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.163668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.164262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.164578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.164849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.165538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:13.165836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.167208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.172102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.175300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 109/214] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:13.176150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.228640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 106/215] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:12 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:22:13.228640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.276656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.291940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc1eb4-eecc-4f27-b63e-196e56fb8aaf None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.339311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.339981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.340263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.340450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324c1e-a84c-40cb-869f-e8db4210e3f4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.340649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.355415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:13.360942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:13.361897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:13.362706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 110/216] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:13.368114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.383986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.385273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.385667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.385935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] PATH_INFO: `/v3/users/c9adc8edda554fcea85323b87b87c6d4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.403390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] RBAC: Authorizing `identity:get_user(user_id=c9adc8edda554fcea85323b87b87c6d4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.404909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.406857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 107/217] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/users/c9adc8edda554fcea85323b87b87c6d4 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:13.413790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.440983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.487375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9619125-9dc1-4528-9f1e-2765fa6efc7c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.531183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd82ed-9151-4824-b83f-3fc7be69a489 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.534128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.537024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.537951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.538240 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.538624 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.539299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:13.539596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.542069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.554124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 111/218] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:13.561117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.574212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.574814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.575114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.575515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.576723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] RBAC: Adding query filter params (role.id=781606224bfd4b6887aa0c545e3af45a, user.id=c9adc8edda554fcea85323b87b87c6d4, scope.system=all) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:13.577170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.579371 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.588354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 108/219] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/role_assignments?user.id=c9adc8edda554fcea85323b87b87c6d4&scope.system=all&role.id=781606224bfd4b6887aa0c545e3af45a => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:13.691755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7b89b-f28c-4299-a0a2-104c41923015 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.723139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.736337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.737926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.737926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.737926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] PATH_INFO: `/v3/users/6f54cea7bc504f9d878572b5aa717cef` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.738741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=6f54cea7bc504f9d878572b5aa717cef)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.740319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:13.742263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 112/220] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/users/6f54cea7bc504f9d878572b5aa717cef => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:13.748900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:13.855013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9da22b-11b1-46f5-ac18-66121b2d5ee7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:13.889865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:13.890779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:13.891267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:13.891727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:13.927273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:13.980321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:13.982257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.084180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 109/221] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:14.090339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.231209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13020fda-70fb-4487-a66c-f229c36cb8a7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.266561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9adb2-67a4-47c5-962c-8e53df80d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.267187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9adb2-67a4-47c5-962c-8e53df80d3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.267464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9adb2-67a4-47c5-962c-8e53df80d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.267737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9adb2-67a4-47c5-962c-8e53df80d3b1 None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.268880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9adb2-67a4-47c5-962c-8e53df80d3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.270317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9adb2-67a4-47c5-962c-8e53df80d3b1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.272326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 113/222] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:14.281824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:14.368990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:14.415693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e562e9-8426-47ab-957c-391f9684b1bf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:14.451130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374bcc4-184e-4e4e-ad5e-423236bdac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:14.451763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374bcc4-184e-4e4e-ad5e-423236bdac77 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:14.452021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374bcc4-184e-4e4e-ad5e-423236bdac77 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:14.452265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374bcc4-184e-4e4e-ad5e-423236bdac77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:14.453016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374bcc4-184e-4e4e-ad5e-423236bdac77 None admin] RBAC: Adding query filter params (role.id=4e42596f37da423aace7e51d7dd1b97c, scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd, user.id=6f54cea7bc504f9d878572b5aa717cef) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:14.453320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374bcc4-184e-4e4e-ad5e-423236bdac77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:14.454837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374bcc4-184e-4e4e-ad5e-423236bdac77 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:14.460950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 110/223] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:14 2022] GET /identity/v3/role_assignments?user.id=6f54cea7bc504f9d878572b5aa717cef&scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd&role.id=4e42596f37da423aace7e51d7dd1b97c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:15.688701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca1ba-96d0-4300-9970-62e3bedc7c9f None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.689213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca1ba-96d0-4300-9970-62e3bedc7c9f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.689287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca1ba-96d0-4300-9970-62e3bedc7c9f None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.690729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 114/224] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:15.696046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576badc2-fdcb-42c8-b6c3-c8995ab20078 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.696985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576badc2-fdcb-42c8-b6c3-c8995ab20078 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.697157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576badc2-fdcb-42c8-b6c3-c8995ab20078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.697306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a8a1-c55f-48fd-823b-21942914785a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.697620 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a8a1-c55f-48fd-823b-21942914785a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.697896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a8a1-c55f-48fd-823b-21942914785a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.699592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 115/225] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:15.704508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711788b-354b-46e7-92fe-f862f06c16f0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.704795 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711788b-354b-46e7-92fe-f862f06c16f0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.705071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b711788b-354b-46e7-92fe-f862f06c16f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.716130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-576badc2-fdcb-42c8-b6c3-c8995ab20078 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:15.717329 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-576badc2-fdcb-42c8-b6c3-c8995ab20078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:15.727406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b711788b-354b-46e7-92fe-f862f06c16f0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:15.728932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b711788b-354b-46e7-92fe-f862f06c16f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:15.792235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:15.794294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 111/226] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:15.807774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 116/227] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:15.890043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d853a-24ee-4ab5-8c84-bfdd40c94233 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.890349 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d853a-24ee-4ab5-8c84-bfdd40c94233 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.890599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d853a-24ee-4ab5-8c84-bfdd40c94233 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.892087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 112/228] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:15.897044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204feaa7-f45e-45f6-9109-e01522a04ab0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:15.897330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204feaa7-f45e-45f6-9109-e01522a04ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:15.897602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204feaa7-f45e-45f6-9109-e01522a04ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:15.916667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-204feaa7-f45e-45f6-9109-e01522a04ab0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:15.917850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-204feaa7-f45e-45f6-9109-e01522a04ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:15.983927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 117/229] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:16.077345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d853a-24ee-4ab5-8c84-bfdd40c94233 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.083851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204feaa7-f45e-45f6-9109-e01522a04ab0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.163263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:16.202987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204feaa7-f45e-45f6-9109-e01522a04ab0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.210540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d853a-24ee-4ab5-8c84-bfdd40c94233 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.221812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:16.239492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.240178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.240488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.240757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.241959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.244000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.246654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.247289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.247570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.247847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.250678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 118/230] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:16.251524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.259747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:16.264976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:16.265896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:16.269298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 113/231] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:16.272415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.364894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7694280-d7f5-4db8-bb9d-4fd3f74450f8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.379803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5e204-7304-4a8d-bfeb-5b00fdee10c6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.400932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.401130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:16.401544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.401821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.402095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] PATH_INFO: `/v3/groups` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.402728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.404365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.415427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.416023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.416295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.416591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.417286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:16.417582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.418928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.427234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 114/232] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:16.428003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.490862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 119/233] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Nov 2 07:22:16 2022] POST /identity/v3/groups => generated 229 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:16.491622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.533876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c03ae3-443c-41ca-8fdc-70465dad7c0d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.552021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:16.577102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.577889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.578169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.578440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.593720 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:16.600549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:16.601716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:16.603206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 115/234] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:16.610020 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.615510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf7b9-c943-4d4b-b386-025ef24507c4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.658338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.658983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.659576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.659685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:16.659897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] PATH_INFO: `/v3/users/c59846fa71584e50a32f3a49abffc69b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.677469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] RBAC: Authorizing `identity:get_user(user_id=c59846fa71584e50a32f3a49abffc69b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.678956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.680897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 120/235] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/users/c59846fa71584e50a32f3a49abffc69b => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:16.687659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.726814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0384-2cab-4cd6-8614-ba1eb50d5c8b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.761924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.762450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.762723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.762986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.763645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:16.763938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.765345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.773618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 116/236] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:16.779083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:16.812332 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e330fc-9e7e-48c0-9864-e608262c5147 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.814697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:16.850004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.850603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.850882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.851144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.851863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] RBAC: Adding query filter params (role.id=4e42596f37da423aace7e51d7dd1b97c, user.id=c59846fa71584e50a32f3a49abffc69b, scope.system=all) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:16.852164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.854274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.859208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 121/237] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/role_assignments?user.id=c59846fa71584e50a32f3a49abffc69b&scope.system=all&role.id=4e42596f37da423aace7e51d7dd1b97c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:16.893468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab71112-16fb-4ba7-b04a-70ae7cbd9ddf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:16.897171 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:16.933482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160b4e9-5504-4169-82e7-cc7492ca8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:16.934140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b4e9-5504-4169-82e7-cc7492ca8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:16.934417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b4e9-5504-4169-82e7-cc7492ca8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:16.934684 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b4e9-5504-4169-82e7-cc7492ca8ca1 None admin] PATH_INFO: `/v3/users/c9adc8edda554fcea85323b87b87c6d4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:16.935876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160b4e9-5504-4169-82e7-cc7492ca8ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=c9adc8edda554fcea85323b87b87c6d4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:16.937450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160b4e9-5504-4169-82e7-cc7492ca8ca1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:16.939377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 117/238] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:16 2022] GET /identity/v3/users/c9adc8edda554fcea85323b87b87c6d4 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:16.944986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:17.073734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1288d-8df6-4eff-aa17-fa1ab7d7c5b0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:17.111272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b802e-e154-481e-829b-4b31b80cfab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:17.111929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b802e-e154-481e-829b-4b31b80cfab8 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:17.112199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b802e-e154-481e-829b-4b31b80cfab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:17.112499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b802e-e154-481e-829b-4b31b80cfab8 None admin] PATH_INFO: `/v3/system/users/c9adc8edda554fcea85323b87b87c6d4/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:17.113985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b802e-e154-481e-829b-4b31b80cfab8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c9adc8edda554fcea85323b87b87c6d4, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:17.115362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b802e-e154-481e-829b-4b31b80cfab8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:17.249172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 122/239] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Nov 2 07:22:16 2022] PUT /identity/v3/system/users/c9adc8edda554fcea85323b87b87c6d4/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:19.040596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf538de-424a-4fd9-b05d-df6bed5ffb42 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.041111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf538de-424a-4fd9-b05d-df6bed5ffb42 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.041111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf538de-424a-4fd9-b05d-df6bed5ffb42 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.042612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 118/240] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:19.047600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1c43c-217d-49aa-8e2b-4bf8d7827b7c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1c43c-217d-49aa-8e2b-4bf8d7827b7c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.048154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1c43c-217d-49aa-8e2b-4bf8d7827b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.066854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8dd1c43c-217d-49aa-8e2b-4bf8d7827b7c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:19.068019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8dd1c43c-217d-49aa-8e2b-4bf8d7827b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:19.094763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.138615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 123/241] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:19.306756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194016-c20c-49a2-ab81-e87aacf462d4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.307045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194016-c20c-49a2-ab81-e87aacf462d4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.307269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8194016-c20c-49a2-ab81-e87aacf462d4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.308613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 119/242] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:19.314794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809e39-6ee0-4559-bd3c-d224cec58387 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.315086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809e39-6ee0-4559-bd3c-d224cec58387 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.315341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96809e39-6ee0-4559-bd3c-d224cec58387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.334512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-96809e39-6ee0-4559-bd3c-d224cec58387 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:19.335677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-96809e39-6ee0-4559-bd3c-d224cec58387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:19.403265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 124/243] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:19.411156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8194016-c20c-49a2-ab81-e87aacf462d4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.420772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65a9c-7541-4e13-815a-143d4a9e7d71 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.421059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65a9c-7541-4e13-815a-143d4a9e7d71 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.421336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65a9c-7541-4e13-815a-143d4a9e7d71 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.422692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 125/244] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:19.427652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e613ac9-41cf-41ff-9c2d-6ba22168ad33 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.427938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e613ac9-41cf-41ff-9c2d-6ba22168ad33 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.428209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e613ac9-41cf-41ff-9c2d-6ba22168ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.447021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1e613ac9-41cf-41ff-9c2d-6ba22168ad33 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:19.448266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1e613ac9-41cf-41ff-9c2d-6ba22168ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:19.518224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8194016-c20c-49a2-ab81-e87aacf462d4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.520574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 126/245] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:19.551828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.552462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.552745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.553013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.562932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:19.567619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:19.568941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:19.569781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 120/246] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:19.574934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e613ac9-41cf-41ff-9c2d-6ba22168ad33 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.599249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.668144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.678308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e613ac9-41cf-41ff-9c2d-6ba22168ad33 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.700253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.717296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.718163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.718453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.718726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.719553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:19.719856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.721594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.732250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 127/247] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:19.737414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.777419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cbed4-b55c-409d-948f-5742dddc7760 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.811902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.812549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.812823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.813132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.814163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.815608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.817189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 121/248] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:19.821347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.823122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.838346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f3003-e1b9-4e4b-975e-303b08b399f1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.871432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.872054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.872332 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.872635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] PATH_INFO: `/v3/users/c59846fa71584e50a32f3a49abffc69b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.873749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] RBAC: Authorizing `identity:get_user(user_id=c59846fa71584e50a32f3a49abffc69b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:19.875182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:19.876798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 128/249] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/users/c59846fa71584e50a32f3a49abffc69b => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:19.877526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.921844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:19.924554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ada22-8585-40b6-abe8-d125fe19a69d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:19.958165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:19.958785 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:19.959057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:19.959337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:19.969106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:19.973873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:19.974914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 122/250] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:19.975753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:19.976517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3e7b5-eeac-43f1-adb4-7f8edc11d244 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:20.012744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:20.013339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:20.013619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:20.013890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] PATH_INFO: `/v3/groups` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:20.014512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:20.015944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:20.073667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ca868-3c0a-45f1-a0c8-51e65115da8d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:20.099715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 129/251] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Nov 2 07:22:19 2022] POST /identity/v3/groups => generated 226 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:20.100569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:20.106154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:20.106890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:20.107110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:20.107378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] PATH_INFO: `/v3/system/users/c59846fa71584e50a32f3a49abffc69b/roles/4e42596f37da423aace7e51d7dd1b97c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:20.108950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c59846fa71584e50a32f3a49abffc69b, role_id=4e42596f37da423aace7e51d7dd1b97c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:20.110399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:20.125904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:20.177703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 123/252] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Nov 2 07:22:19 2022] PUT /identity/v3/system/users/c59846fa71584e50a32f3a49abffc69b/roles/4e42596f37da423aace7e51d7dd1b97c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:20.232521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb0433-c3b6-4a0e-878c-a510cddd9ea1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:20.274128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:20.274796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:20.275078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:20.275351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:20.276049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:20.276354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:20.277819 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:20.292457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 130/253] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:20.294609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:20.327529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:20.411384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d202d-5c0c-4523-bb77-f010ced7d528 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:20.448104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515e1e4-86c2-4876-b7e2-42d494288547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:20.448778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e1e4-86c2-4876-b7e2-42d494288547 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:20.449056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e1e4-86c2-4876-b7e2-42d494288547 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:20.449325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e1e4-86c2-4876-b7e2-42d494288547 None admin] PATH_INFO: `/v3/users/c9adc8edda554fcea85323b87b87c6d4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:20.450462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515e1e4-86c2-4876-b7e2-42d494288547 None admin] RBAC: Authorizing `identity:get_user(user_id=c9adc8edda554fcea85323b87b87c6d4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:20.451951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515e1e4-86c2-4876-b7e2-42d494288547 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:20.453927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 124/254] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:20 2022] GET /identity/v3/users/c9adc8edda554fcea85323b87b87c6d4 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:20.459707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:20.542864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:20.570137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed1326-c0e9-4d09-a250-9ab307ec78bf None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:20.604957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c8bb-8dd7-4368-8864-d7cb84c62480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:20.605628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c8bb-8dd7-4368-8864-d7cb84c62480 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:20.605907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c8bb-8dd7-4368-8864-d7cb84c62480 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:20.606173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c8bb-8dd7-4368-8864-d7cb84c62480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:20.606899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c8bb-8dd7-4368-8864-d7cb84c62480 None admin] RBAC: Adding query filter params (role.id=781606224bfd4b6887aa0c545e3af45a, user.id=c9adc8edda554fcea85323b87b87c6d4, scope.system=all) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:20.607213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c8bb-8dd7-4368-8864-d7cb84c62480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:20.608678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c8bb-8dd7-4368-8864-d7cb84c62480 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:20.624362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 131/255] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:20 2022] GET /identity/v3/role_assignments?user.id=c9adc8edda554fcea85323b87b87c6d4&scope.system=all&role.id=781606224bfd4b6887aa0c545e3af45a => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:22.440553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a193-a816-4369-9a5b-4f6af376f286 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.441029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a193-a816-4369-9a5b-4f6af376f286 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.441029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a193-a816-4369-9a5b-4f6af376f286 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.442486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 125/256] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:22.448421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f654ea-5976-4836-af3b-5f56f5da7663 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.448839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f654ea-5976-4836-af3b-5f56f5da7663 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.449036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f654ea-5976-4836-af3b-5f56f5da7663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.454861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06466-ae2d-46e0-be04-2502dee4fbdc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.455144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06466-ae2d-46e0-be04-2502dee4fbdc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.455418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b06466-ae2d-46e0-be04-2502dee4fbdc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.456911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 126/257] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:22.466689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584821-0899-4d4c-8346-18069218dacb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:22.466978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584821-0899-4d4c-8346-18069218dacb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:22.467256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e584821-0899-4d4c-8346-18069218dacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:22.484594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-60f654ea-5976-4836-af3b-5f56f5da7663 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:22.485818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-60f654ea-5976-4836-af3b-5f56f5da7663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:22.497917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4e584821-0899-4d4c-8346-18069218dacb None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:22.499115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4e584821-0899-4d4c-8346-18069218dacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:22.631018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 132/258] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:22:22.660235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 127/259] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:22.989715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f654ea-5976-4836-af3b-5f56f5da7663 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.082756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.118141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f654ea-5976-4836-af3b-5f56f5da7663 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.156063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e584821-0899-4d4c-8346-18069218dacb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.161621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.163569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.163569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.163569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.174575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:23.175740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e584821-0899-4d4c-8346-18069218dacb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:23.180442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:23.181323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:23.182120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 133/260] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:23.189863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.191017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.191518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.191979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.197029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.209436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:23.215453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:23.216351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:23.220051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:23.222703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 128/261] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:23.228452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.245416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3479-57b0-4a7e-8ae5-ea94f8b24106 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.253279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.254238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.254675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.255198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.256865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:23.256865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.259383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:23.259383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:22:23.259383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:22:23.260785 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.273594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.282993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 129/262] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.288045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.301571 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57961d74-21f6-402d-8277-92f8eeff5063 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.311185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.312186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.312839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.313307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.325601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.327041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:23.327041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:22:23.327041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:22:23.328892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.330965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 130/263] 10.222.0.39 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:23.336656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.350115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac708b3e-a723-4a2a-84e7-1061606a084e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.354750 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033eb30-a458-4a8f-bd6b-ca3b65c49402 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.359580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d0765-b087-4ff9-9590-9426cfb27a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.360517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0765-b087-4ff9-9590-9426cfb27a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.361033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0765-b087-4ff9-9590-9426cfb27a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.361515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0765-b087-4ff9-9590-9426cfb27a32 admin admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.362866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d0765-b087-4ff9-9590-9426cfb27a32 admin admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.365294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d0765-b087-4ff9-9590-9426cfb27a32 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.367228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 131/264] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:23.368797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8ef3c-979c-49b3-b60b-b26dfa45492f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.369381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8ef3c-979c-49b3-b60b-b26dfa45492f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.369873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8ef3c-979c-49b3-b60b-b26dfa45492f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.371389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 132/265] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:23.373674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8ef3c-979c-49b3-b60b-b26dfa45492f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.393589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8ef3c-979c-49b3-b60b-b26dfa45492f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.395106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a575-9e20-41d5-834f-d27ec0bc347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.395859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a575-9e20-41d5-834f-d27ec0bc347f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.396220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a575-9e20-41d5-834f-d27ec0bc347f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.396521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a575-9e20-41d5-834f-d27ec0bc347f None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.397200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a575-9e20-41d5-834f-d27ec0bc347f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:23.397499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a575-9e20-41d5-834f-d27ec0bc347f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.400060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557a575-9e20-41d5-834f-d27ec0bc347f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.401624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb992-e15f-4d1a-b1de-6f1b13801a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.402619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb992-e15f-4d1a-b1de-6f1b13801a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.403094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb992-e15f-4d1a-b1de-6f1b13801a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.403569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb992-e15f-4d1a-b1de-6f1b13801a94 admin admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.405495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.407099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb992-e15f-4d1a-b1de-6f1b13801a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34dde8575f264f5c8c8484f0d25a1802, group_id=72d82bfedf4c468cb9e9ee3c04557c03, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.408402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-07dcb992-e15f-4d1a-b1de-6f1b13801a94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:23.408402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:22:23.408402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:22:23.410364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 134/266] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.414955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb992-e15f-4d1a-b1de-6f1b13801a94 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.415098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc14a85-69d7-43e5-9d2f-f57f4d1b7e6b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.415098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc14a85-69d7-43e5-9d2f-f57f4d1b7e6b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.415098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc14a85-69d7-43e5-9d2f-f57f4d1b7e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.433504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6fc14a85-69d7-43e5-9d2f-f57f4d1b7e6b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:23.434704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6fc14a85-69d7-43e5-9d2f-f57f4d1b7e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:23.445588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 135/267] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:22:23.447555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784ba6-db6c-423e-a27b-ae30789fd3d0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.447849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784ba6-db6c-423e-a27b-ae30789fd3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.448184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66784ba6-db6c-423e-a27b-ae30789fd3d0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.449496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 136/268] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:23.450184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66784ba6-db6c-423e-a27b-ae30789fd3d0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.514581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 133/269] 10.222.0.39 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:23 2022] PUT /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:23.517223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf080-a001-468f-b4f2-4595aa448b23 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.518291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf080-a001-468f-b4f2-4595aa448b23 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.519099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bf080-a001-468f-b4f2-4595aa448b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.544723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f69bf080-a001-468f-b4f2-4595aa448b23 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:23.546263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f69bf080-a001-468f-b4f2-4595aa448b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:23.579793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66784ba6-db6c-423e-a27b-ae30789fd3d0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.625604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.626699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.626893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 134/270] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:22:23.627413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.627876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] PATH_INFO: `/v3/users/c59846fa71584e50a32f3a49abffc69b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.634339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] RBAC: Authorizing `identity:get_user(user_id=c59846fa71584e50a32f3a49abffc69b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.636207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.638288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 137/271] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/users/c59846fa71584e50a32f3a49abffc69b => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.644651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf080-a001-468f-b4f2-4595aa448b23 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.766783 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bf080-a001-468f-b4f2-4595aa448b23 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.794777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:23.807474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.808086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.808360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.808656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.809517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] RBAC: Adding query filter params (role.id=4e42596f37da423aace7e51d7dd1b97c, user.id=c59846fa71584e50a32f3a49abffc69b, scope.system=all) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:23.809830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.815057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:23.825606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 135/272] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/role_assignments?user.id=c59846fa71584e50a32f3a49abffc69b&scope.system=all&role.id=4e42596f37da423aace7e51d7dd1b97c => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:23.922684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.935171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9989e84-a8de-4736-ab5e-61eb4fcbb36b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.939703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.940399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.940698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.940968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.954792 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:23.959683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:23.960649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:23.961463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 138/273] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:23.966754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:23.980411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3028a6-a1f0-4b6a-82aa-3f6a88c9f1a2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:23.988803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:23.989482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:23.989761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:23.990030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:23.990763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:23.991067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:23.992914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.009353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 136/274] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.014641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.026075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad035ed-efc3-407c-96ed-ae8bbe3f20fc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.031257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.031948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.032228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.032518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.033747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.035595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:24.035595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:22:24.035595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:22:24.036966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.038630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 139/275] 10.222.0.39 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.044808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.061458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62f788-d07d-4ab0-a9a5-4cfb3f197cd7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.066166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.066840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.067117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.067389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.068664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.070921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.072853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 137/276] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.078365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.088940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0377d2-4a92-40b8-9eb0-d7362b360c80 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.093824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.094465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.094744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.095070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.097413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d6c8b711fa4a978e3fd79ba5858acd, group_id=72d82bfedf4c468cb9e9ee3c04557c03, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.098558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:24.098558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:22:24.098558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:22:24.100651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.134350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.144923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10074d-4e2e-42f0-9473-ec39bf093181 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.153478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.154106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.154386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.154652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.180253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 140/277] 10.222.0.39 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:24 2022] PUT /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:24.181167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:24.186106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:24.188397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:24.190698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 138/278] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:24.199003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.254444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:24.282034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc619937-43f4-4a05-84c0-8224cf0750f8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.288305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.288946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.289225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.291622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.292331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:24.292664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.293681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:22:24.293681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:22:24.293681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:22:24.294643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.306707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 141/279] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.312627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.329635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683429e-38df-4871-8e3f-747f191b7760 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.334423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.335120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.335396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.335665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.337576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.339620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.341771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 139/280] 10.222.0.39 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.347587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.363850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2b7a1-4adf-4092-b851-666e2bbebdff admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.373041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144d373-5be5-42d6-9cac-3ddfa1f7da5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.373690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144d373-5be5-42d6-9cac-3ddfa1f7da5b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.374013 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144d373-5be5-42d6-9cac-3ddfa1f7da5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.374284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144d373-5be5-42d6-9cac-3ddfa1f7da5b admin admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.375497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144d373-5be5-42d6-9cac-3ddfa1f7da5b admin admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.377816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144d373-5be5-42d6-9cac-3ddfa1f7da5b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.380064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 142/281] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:24 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:24.386372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:24.399921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5425d-4f84-4af7-8d51-b09554708c3b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:24.408389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333fca-d86a-42b6-aee4-1d06a8d2edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:24.409514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333fca-d86a-42b6-aee4-1d06a8d2edbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.410009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333fca-d86a-42b6-aee4-1d06a8d2edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.410473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333fca-d86a-42b6-aee4-1d06a8d2edbe admin admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/9633c4426fd245b7ad054ad7ca81ce1c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.414680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333fca-d86a-42b6-aee4-1d06a8d2edbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=34dde8575f264f5c8c8484f0d25a1802, group_id=72d82bfedf4c468cb9e9ee3c04557c03, role_id=9633c4426fd245b7ad054ad7ca81ce1c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:24.418322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333fca-d86a-42b6-aee4-1d06a8d2edbe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:24.544638 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 140/282] 10.222.0.39 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:24 2022] PUT /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/9633c4426fd245b7ad054ad7ca81ce1c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:24.958964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be08a3f-7f66-4a15-a092-7092e247c4d9 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.960239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be08a3f-7f66-4a15-a092-7092e247c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.960772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be08a3f-7f66-4a15-a092-7092e247c4d9 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.962355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 143/283] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:24.967943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715544c-7620-421c-8988-ebcdd6e9b3c5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:24.968230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715544c-7620-421c-8988-ebcdd6e9b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:24.968524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715544c-7620-421c-8988-ebcdd6e9b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:24.990284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a715544c-7620-421c-8988-ebcdd6e9b3c5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:24.991494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a715544c-7620-421c-8988-ebcdd6e9b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:25.074745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 141/284] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:22:25.445802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c723a3-e288-4333-b94d-95c672165be1 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.447048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c723a3-e288-4333-b94d-95c672165be1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.447553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c723a3-e288-4333-b94d-95c672165be1 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.449145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 144/285] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:25.454762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6495c-7715-4dc2-aacc-ea18b0087d44 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.455040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6495c-7715-4dc2-aacc-ea18b0087d44 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.455310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6495c-7715-4dc2-aacc-ea18b0087d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.479784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a2b6495c-7715-4dc2-aacc-ea18b0087d44 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:25.480986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a2b6495c-7715-4dc2-aacc-ea18b0087d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:25.488714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 142/286] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 07:22:25.548267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c723a3-e288-4333-b94d-95c672165be1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:25.564084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c723a3-e288-4333-b94d-95c672165be1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:25.571779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:25.572672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.573149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.573610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.591163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:25.600479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:25.601391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:25.602757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:25.605060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 145/287] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Nov 2 07:22:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:25.611016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6495c-7715-4dc2-aacc-ea18b0087d44 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:25.625516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6495c-7715-4dc2-aacc-ea18b0087d44 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:25.632448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:25.633047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.633319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.633617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.634342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:25.634636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:25.636276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:25.649906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 143/288] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Nov 2 07:22:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:25.655354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:25.670464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42028be8-c1ad-43f3-8a1c-c393a98dacd4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:25.685171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:25.686154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.686628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.687093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.688540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:25.690729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:25.692582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 146/289] 10.222.0.39 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:25 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:25.698472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:25.712225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96f38-6f4e-44a4-b158-3c79ead04dd0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:25.719386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:25.720016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.720335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.726274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.726274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:25.728405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:25.731440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 144/290] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:25 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:25.737934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:25.752405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269edd-91a1-4f8f-998a-4044e81b624b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:25.760406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:25.761333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:25.761812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:25.762280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/9633c4426fd245b7ad054ad7ca81ce1c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:25.764637 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d6c8b711fa4a978e3fd79ba5858acd, group_id=72d82bfedf4c468cb9e9ee3c04557c03, role_id=9633c4426fd245b7ad054ad7ca81ce1c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:25.767476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:25.855795 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 147/291] 10.222.0.39 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:25 2022] PUT /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd/groups/72d82bfedf4c468cb9e9ee3c04557c03/roles/9633c4426fd245b7ad054ad7ca81ce1c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:25.950172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:25.961113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04787-d51c-45ca-9216-9f17da6e4009 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.042154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.042868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.043141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.043410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.062183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:26.067704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:26.068678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:26.069467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 145/292] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:22:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:26.076031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.091177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a394bc-dd31-41c3-8b29-c5229c197962 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.110250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.111422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.111933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.112399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.113313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:26.113808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.115593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.129960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 148/293] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:26.135451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.151426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:26.155902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589954d-eb6c-4df8-a380-f931a1c1b460 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.167153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.167857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.168138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.168407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] PATH_INFO: `/v3/groups/e93d87022bcd469f9989b9fd0d8b202e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.175478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] RBAC: Authorizing `identity:get_group(group_id=e93d87022bcd469f9989b9fd0d8b202e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.177466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.183957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 146/294] 10.222.0.39 () {56 vars in 1201 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/groups/e93d87022bcd469f9989b9fd0d8b202e => generated 229 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:26.185675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.203006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c0cd-fed1-499d-ae01-8adb5661afed admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.207578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd87ec6-ef4f-427e-bd7a-608e553c9456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.208320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87ec6-ef4f-427e-bd7a-608e553c9456 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.208651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87ec6-ef4f-427e-bd7a-608e553c9456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.208918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd87ec6-ef4f-427e-bd7a-608e553c9456 admin admin] PATH_INFO: `/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.210288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd87ec6-ef4f-427e-bd7a-608e553c9456 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2956e4c40564dd2b6b8960e97f61ae3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.212284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd87ec6-ef4f-427e-bd7a-608e553c9456 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.214404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 149/295] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Nov 2 07:22:26 2022] GET /identity/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:26.220541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:26.233662 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637dd7-0948-4600-b11c-fc5dd40c79db admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:26.241487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e850d7-6b42-46c0-a96c-be377a01c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:26.242213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e850d7-6b42-46c0-a96c-be377a01c299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.242488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e850d7-6b42-46c0-a96c-be377a01c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.242862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e850d7-6b42-46c0-a96c-be377a01c299 admin admin] PATH_INFO: `/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3/groups/e93d87022bcd469f9989b9fd0d8b202e/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.245843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e850d7-6b42-46c0-a96c-be377a01c299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2956e4c40564dd2b6b8960e97f61ae3, group_id=e93d87022bcd469f9989b9fd0d8b202e, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:26.248715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e850d7-6b42-46c0-a96c-be377a01c299 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:26.329440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 147/296] 10.222.0.39 () {58 vars in 1463 bytes} [Wed Nov 2 07:22:26 2022] PUT /identity/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3/groups/e93d87022bcd469f9989b9fd0d8b202e/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:26.728043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628bc40-4137-48fd-87db-8d765de4abbc None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.728422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628bc40-4137-48fd-87db-8d765de4abbc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.728631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628bc40-4137-48fd-87db-8d765de4abbc None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.730425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 150/297] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:26.736213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e40aa-3584-40b7-aef3-779f2101cded None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.736980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e40aa-3584-40b7-aef3-779f2101cded None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.736980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e40aa-3584-40b7-aef3-779f2101cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.755458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f52e40aa-3584-40b7-aef3-779f2101cded None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:26.757157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f52e40aa-3584-40b7-aef3-779f2101cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:26.832587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 148/298] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:26.907150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6bb7f-7fca-487c-abda-9f9a0e61b638 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.907451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6bb7f-7fca-487c-abda-9f9a0e61b638 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.907770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6bb7f-7fca-487c-abda-9f9a0e61b638 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.909432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 151/299] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:26.914490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531356fc-6b1c-4074-950a-9e51aa809557 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:26.915600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531356fc-6b1c-4074-950a-9e51aa809557 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:26.916081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531356fc-6b1c-4074-950a-9e51aa809557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:26.937121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-531356fc-6b1c-4074-950a-9e51aa809557 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:26.938632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-531356fc-6b1c-4074-950a-9e51aa809557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:27.011685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 149/300] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:27.306556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6bb7f-7fca-487c-abda-9f9a0e61b638 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.314241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531356fc-6b1c-4074-950a-9e51aa809557 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.420953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:27.529326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531356fc-6b1c-4074-950a-9e51aa809557 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.530524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6bb7f-7fca-487c-abda-9f9a0e61b638 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.583419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:27.591033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.592026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.592305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.592602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.601360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.601360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.601360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.601360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.615913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:27.621198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:27.622089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:27.622894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:27.623513 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:27.628187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:27.629114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:27.629895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 150/301] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:27.631313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.631381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 152/302] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:27.636643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.769045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e75273-245b-4e73-87b8-e69bf9cea0a0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.784979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:27.841809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.842339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.843766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.844044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.844764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:27.845062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:27.846487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:27.851668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa4d13-01b8-4e9e-b8c6-a703de468adb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:27.869817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 151/303] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:27.875617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:27.922208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:27.922825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:27.923104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:27.923372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:27.924039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] RBAC: Adding query filter params (name=member) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:27.924337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:27.925735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:27.944067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 153/304] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:27.953501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:28.033979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.049508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f052f0-c98e-45b5-986a-57cdfa6f3bcd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:28.091927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d4a61-36ef-4c1a-b74c-7937359c3925 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:28.094634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c71ce-6c22-4ae3-a2aa-826a7e257dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:28.095463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c71ce-6c22-4ae3-a2aa-826a7e257dec None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.095933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c71ce-6c22-4ae3-a2aa-826a7e257dec None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.096419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c71ce-6c22-4ae3-a2aa-826a7e257dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.132453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92610308-a9b8-47cc-9ffd-c2ea270b26d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:28.132453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610308-a9b8-47cc-9ffd-c2ea270b26d1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.132453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610308-a9b8-47cc-9ffd-c2ea270b26d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.132453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610308-a9b8-47cc-9ffd-c2ea270b26d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.137467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.177933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c71ce-6c22-4ae3-a2aa-826a7e257dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:28.179451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c71ce-6c22-4ae3-a2aa-826a7e257dec None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:28.223758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92610308-a9b8-47cc-9ffd-c2ea270b26d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:28.225263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92610308-a9b8-47cc-9ffd-c2ea270b26d1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:28.299448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.301433 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 152/305] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:28.302798 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a971479-9f34-4d7e-9247-e48e84022c08 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.303085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a971479-9f34-4d7e-9247-e48e84022c08 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.303354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a971479-9f34-4d7e-9247-e48e84022c08 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.305972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 153/306] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:28.309645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a971479-9f34-4d7e-9247-e48e84022c08 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:28.385962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 154/307] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:28.387164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34774a-72a3-4340-862c-78f9a0c55789 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.387448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34774a-72a3-4340-862c-78f9a0c55789 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.387712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34774a-72a3-4340-862c-78f9a0c55789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.397704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.406698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2d34774a-72a3-4340-862c-78f9a0c55789 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:28.407870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2d34774a-72a3-4340-862c-78f9a0c55789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:28.436974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a971479-9f34-4d7e-9247-e48e84022c08 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:28.475530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:28.476156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.476451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.476732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.478654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:28.480886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:28.483030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 154/308] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:28 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:28.483798 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:28.490018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 155/309] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:28.490857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34774a-72a3-4340-862c-78f9a0c55789 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:28.609735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31fe2f-f365-4976-9657-838f0eac9844 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:28.620523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.657899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34774a-72a3-4340-862c-78f9a0c55789 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:28.660372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a632136-b3a2-4386-95c8-dad4407d45cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:28.661706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632136-b3a2-4386-95c8-dad4407d45cc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.661706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632136-b3a2-4386-95c8-dad4407d45cc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.661706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a632136-b3a2-4386-95c8-dad4407d45cc None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.662661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a632136-b3a2-4386-95c8-dad4407d45cc None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:28.664100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a632136-b3a2-4386-95c8-dad4407d45cc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:28.666281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 155/310] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:28 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:28.668727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3c53-7e3c-4bfd-bd76-bdcd589aa8a5 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.668865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3c53-7e3c-4bfd-bd76-bdcd589aa8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.669034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac3c53-7e3c-4bfd-bd76-bdcd589aa8a5 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.670224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 156/311] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:28.675114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3c53-7e3c-4bfd-bd76-bdcd589aa8a5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:28.678419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.708222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01eab1-9253-4184-a057-6e628569ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:28.709042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01eab1-9253-4184-a057-6e628569ffec None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.709410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01eab1-9253-4184-a057-6e628569ffec None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.712896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01eab1-9253-4184-a057-6e628569ffec None admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.714172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01eab1-9253-4184-a057-6e628569ffec None admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:28.715710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01eab1-9253-4184-a057-6e628569ffec None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:28.717351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 156/312] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:28 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:28.719236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc3e4e-eca3-4213-9752-f5a1a95dfedc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.719236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc3e4e-eca3-4213-9752-f5a1a95dfedc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.719407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc3e4e-eca3-4213-9752-f5a1a95dfedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.740469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-99fc3e4e-eca3-4213-9752-f5a1a95dfedc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:28.742380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-99fc3e4e-eca3-4213-9752-f5a1a95dfedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:28.806873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac3c53-7e3c-4bfd-bd76-bdcd589aa8a5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:28.840492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 157/313] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:28.840492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc3e4e-eca3-4213-9752-f5a1a95dfedc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:28.867810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:28.868723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:28.869137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:28.869540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:28.870765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:28.872318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:28.875961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 157/314] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:28 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:28.882979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:28.956914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.983949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:28.984825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc3e4e-eca3-4213-9752-f5a1a95dfedc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.019310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51298ff-c151-4e68-bb2b-d7151c316ff7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.021736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.022342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.022620 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.022886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.023671 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] RBAC: Adding query filter params (group.id=72d82bfedf4c468cb9e9ee3c04557c03, role.id=781606224bfd4b6887aa0c545e3af45a, scope.project.id=34dde8575f264f5c8c8484f0d25a1802) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:29.024646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.026079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.032983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 158/315] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:28 2022] GET /identity/v3/role_assignments?group.id=72d82bfedf4c468cb9e9ee3c04557c03&scope.project.id=34dde8575f264f5c8c8484f0d25a1802&role.id=781606224bfd4b6887aa0c545e3af45a => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:29.033854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.061091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f05d0-9305-43de-9426-c9c31a3c3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.062045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f05d0-9305-43de-9426-c9c31a3c3d46 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.062502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f05d0-9305-43de-9426-c9c31a3c3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.062942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f05d0-9305-43de-9426-c9c31a3c3d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.064226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f05d0-9305-43de-9426-c9c31a3c3d46 None admin] RBAC: Adding query filter params (group.id=72d82bfedf4c468cb9e9ee3c04557c03, role.id=781606224bfd4b6887aa0c545e3af45a, scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:29.065218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f05d0-9305-43de-9426-c9c31a3c3d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.067224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f05d0-9305-43de-9426-c9c31a3c3d46 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.074700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 158/316] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:28 2022] GET /identity/v3/role_assignments?group.id=72d82bfedf4c468cb9e9ee3c04557c03&scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd&role.id=781606224bfd4b6887aa0c545e3af45a => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:29.185283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fadc0-e7a1-49c0-8dea-8f1c074d27dd None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.185936 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fadc0-e7a1-49c0-8dea-8f1c074d27dd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.186401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fadc0-e7a1-49c0-8dea-8f1c074d27dd None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.189339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 159/317] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:29.193738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54559-fab2-4f4f-b16f-038582c76581 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.194328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54559-fab2-4f4f-b16f-038582c76581 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.194788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54559-fab2-4f4f-b16f-038582c76581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.204969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357379f2-7090-4c4f-84b6-22a59fc4d96d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.219975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f6e54559-fab2-4f4f-b16f-038582c76581 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:29.223980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f6e54559-fab2-4f4f-b16f-038582c76581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:29.274857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.275586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.275857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.276126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.292885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:29.298251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:29.299236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:29.300515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 159/318] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:29.301541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.305299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.335960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 160/319] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:29.335960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54559-fab2-4f4f-b16f-038582c76581 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.417811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.447277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d98d-4548-4aff-bd8c-58f3473e9f28 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.483896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54559-fab2-4f4f-b16f-038582c76581 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.502567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.504236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.504236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.504236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.521365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:29.527401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:29.528303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:29.529727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 160/320] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:29.533032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.533980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.534464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.534738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.535149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.536024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:29.536549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.538121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.547904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 161/321] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:29.553648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.613259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.663846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620ae76-5b66-491e-aeec-6a574a9f5f18 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.677029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c443b6-5a9d-46da-bc7e-6c8579cc6374 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.703573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.704472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.704742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.705401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:29.705699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.707075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.712580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.716567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 161/322] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:29.717548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.723534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.726202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.726202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.726202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.806182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:29.807574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:29.838595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f18a5-12d8-4dff-ac9e-f37d9a56a5f1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:29.869018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:29.877823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:29.878447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:29.878721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:29.878987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:29.891312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:29.896349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:29.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:29.898065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:29.898665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 162/323] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:29.899292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.929425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 162/324] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:29.931213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:29.962687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.018575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aafcdd-c65c-4f6e-87b9-3833ee49472f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.050397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738582b0-9381-4595-85e5-c018888e0fab None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.057885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.058426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.058701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.058967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.089923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.090529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.090985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.091441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.092246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:30.092683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.094043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.102850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 163/325] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.103466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.121801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.131892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.133984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.195338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.207011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302929d-497d-4596-9e2f-a2d4af303118 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.231497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 163/326] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:30.232405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.240460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.241098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.241376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.241644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] PATH_INFO: `/v3/projects/34dde8575f264f5c8c8484f0d25a1802` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.242760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=34dde8575f264f5c8c8484f0d25a1802)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.244176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.245830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 164/327] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/projects/34dde8575f264f5c8c8484f0d25a1802 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.246570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.320713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.335431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d0a4-cbda-452d-92ad-5cb7dd2a0fe5 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.343567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd392f-b888-40bb-963f-da29cb664cb4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.368797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.369392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.369664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.369927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.376269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.376913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.377191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.377463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] PATH_INFO: `/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.378560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] RBAC: Authorizing `identity:get_project(project_id=92d6c8b711fa4a978e3fd79ba5858acd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.379968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.381605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 165/328] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/projects/92d6c8b711fa4a978e3fd79ba5858acd => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.382360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.410746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.436501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.437954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.485022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e3300-4a90-461c-bf26-a6678880972d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.518121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.518734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.519011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.519130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.519573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.520351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.521817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.523366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 166/329] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.524395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.534572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 164/330] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:30.535393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.616093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.625419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368367-f77a-4a69-9c91-fe370ff2ef63 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.631143 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af6394-dbb7-46ec-99b8-11e0039f471d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.658516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.659130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.659402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.659670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] PATH_INFO: `/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.661039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] RBAC: Authorizing `identity:get_group(group_id=72d82bfedf4c468cb9e9ee3c04557c03)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.662532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.664123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 167/331] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/groups/72d82bfedf4c468cb9e9ee3c04557c03 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.664903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.667689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.668404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.668713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.668986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.669741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] RBAC: Adding query filter params (group.id=72d82bfedf4c468cb9e9ee3c04557c03, role.id=9633c4426fd245b7ad054ad7ca81ce1c, scope.project.id=34dde8575f264f5c8c8484f0d25a1802) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:30.670045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.671463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.692464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 165/332] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/role_assignments?group.id=72d82bfedf4c468cb9e9ee3c04557c03&scope.project.id=34dde8575f264f5c8c8484f0d25a1802&role.id=9633c4426fd245b7ad054ad7ca81ce1c => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.692464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.735503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:30.789001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003778-a9b8-40b6-aa2b-af9869266ce1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.797732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc20f-846e-483a-8259-dbdcb2b54a8b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.827700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.828661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.828947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.829268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.830019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] RBAC: Adding query filter params (group.id=72d82bfedf4c468cb9e9ee3c04557c03, role.id=9633c4426fd245b7ad054ad7ca81ce1c, scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:30.830327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.831796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.834729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:30.835791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:30.835791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:30.835969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] PATH_INFO: `/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:30.837096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] RBAC: Authorizing `identity:get_project(project_id=a2956e4c40564dd2b6b8960e97f61ae3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:30.838554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:30.839021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 166/333] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/role_assignments?group.id=72d82bfedf4c468cb9e9ee3c04557c03&scope.project.id=92d6c8b711fa4a978e3fd79ba5858acd&role.id=9633c4426fd245b7ad054ad7ca81ce1c => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.840212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 168/334] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/projects/a2956e4c40564dd2b6b8960e97f61ae3 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:30.845950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:30.964059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ae58c-02c5-4dd8-a9c2-93c24c78aa29 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:30.981634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:31.002913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe92d1-e4c3-4d0f-9055-30c6d321273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:31.003580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe92d1-e4c3-4d0f-9055-30c6d321273e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:31.003828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe92d1-e4c3-4d0f-9055-30c6d321273e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:31.004097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe92d1-e4c3-4d0f-9055-30c6d321273e None admin] PATH_INFO: `/v3/groups/e93d87022bcd469f9989b9fd0d8b202e` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:31.005260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe92d1-e4c3-4d0f-9055-30c6d321273e None admin] RBAC: Authorizing `identity:get_group(group_id=e93d87022bcd469f9989b9fd0d8b202e)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:31.006706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe92d1-e4c3-4d0f-9055-30c6d321273e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:31.008534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 167/335] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Nov 2 07:22:30 2022] GET /identity/v3/groups/e93d87022bcd469f9989b9fd0d8b202e => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:31.014347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:31.046217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:31.127866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c6ffc-adb0-44af-95e5-38514674b01e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:31.163635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434e661-eb12-4050-95a5-dc43878fe9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:31.164239 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434e661-eb12-4050-95a5-dc43878fe9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:31.165119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434e661-eb12-4050-95a5-dc43878fe9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:31.165396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434e661-eb12-4050-95a5-dc43878fe9d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:31.166120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434e661-eb12-4050-95a5-dc43878fe9d5 None admin] RBAC: Adding query filter params (group.id=e93d87022bcd469f9989b9fd0d8b202e, role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=a2956e4c40564dd2b6b8960e97f61ae3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:31.166427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434e661-eb12-4050-95a5-dc43878fe9d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:31.167867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434e661-eb12-4050-95a5-dc43878fe9d5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:31.173717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 169/336] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Nov 2 07:22:31 2022] GET /identity/v3/role_assignments?group.id=e93d87022bcd469f9989b9fd0d8b202e&scope.project.id=a2956e4c40564dd2b6b8960e97f61ae3&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:33.694943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ff200-e27b-4dfe-affd-67f0fe54f900 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.695619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ff200-e27b-4dfe-affd-67f0fe54f900 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.695619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ff200-e27b-4dfe-affd-67f0fe54f900 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.697726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 168/337] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:33.703158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e7e2-faa3-48cd-96e4-db1d8581850a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:33.703934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e7e2-faa3-48cd-96e4-db1d8581850a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:33.704505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919e7e2-faa3-48cd-96e4-db1d8581850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:33.732078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4919e7e2-faa3-48cd-96e4-db1d8581850a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:33.733585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4919e7e2-faa3-48cd-96e4-db1d8581850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:33.816938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 170/338] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:34.006230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494f60-56c3-4007-bc57-f875913d784e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.006915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494f60-56c3-4007-bc57-f875913d784e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.007406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494f60-56c3-4007-bc57-f875913d784e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.009405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 169/339] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:34.009895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888efb-47bc-45a8-adc5-b3df217023e8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.010176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888efb-47bc-45a8-adc5-b3df217023e8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.010443 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb888efb-47bc-45a8-adc5-b3df217023e8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.012040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 171/340] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:34.015931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2cde1-bde0-4606-99f6-f285b49acf25 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.016400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2cde1-bde0-4606-99f6-f285b49acf25 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.016886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2cde1-bde0-4606-99f6-f285b49acf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.017082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69ab6-748b-433a-8c57-47323175bed1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.017566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69ab6-748b-433a-8c57-47323175bed1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.018014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69ab6-748b-433a-8c57-47323175bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.047289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-88a2cde1-bde0-4606-99f6-f285b49acf25 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:34.048512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-88a2cde1-bde0-4606-99f6-f285b49acf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:34.054164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b4b69ab6-748b-433a-8c57-47323175bed1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:34.055910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b4b69ab6-748b-433a-8c57-47323175bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:34.088551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:34.159495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 170/341] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:34.202113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 172/342] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:34.212258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2cde1-bde0-4606-99f6-f285b49acf25 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:34.358796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2cde1-bde0-4606-99f6-f285b49acf25 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:34.375692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:34.403430 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:34.404099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.404375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.404665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.419442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:34.420961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:34.440262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:34.441326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:34.442857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:34.442857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:34.442857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:34.442857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 171/343] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:34.447798 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69ab6-748b-433a-8c57-47323175bed1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:34.469264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:34.569266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69ab6-748b-433a-8c57-47323175bed1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:34.587366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0704c-38ab-40b7-b0bf-7d48ef6dccab None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:34.620657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:34.621818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.622423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.622970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.623899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:34.624392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:34.625327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:34.626036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.626375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.626645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:34.626763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.638676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:34.640067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:34.642446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 173/344] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:34.647427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:34.656868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:34.657823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:34.664001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:34.664001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:34.664001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:34.664001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 172/345] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:34.664001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:34.670571 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:34.684890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:34.770000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272638b2-36fa-4dc8-8db0-51d14bdb1b88 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:34.777035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc3907-0de2-489e-8adb-7f83bc6bd6b7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:34.806436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba485d-f22a-47e8-9cd6-19b7f970ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:34.807033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba485d-f22a-47e8-9cd6-19b7f970ebd2 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.807410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba485d-f22a-47e8-9cd6-19b7f970ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.807678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba485d-f22a-47e8-9cd6-19b7f970ebd2 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.808341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba485d-f22a-47e8-9cd6-19b7f970ebd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:34.809792 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba485d-f22a-47e8-9cd6-19b7f970ebd2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:34.812686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:34.813305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.813577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.813842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.825078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:34.826492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:34.840558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:34.841676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:34.842530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:34.842530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:34.842530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:34.842530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 174/346] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:34.842530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:34.904082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:34.910710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 173/347] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:34 2022] POST /identity/v3/users => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:34.911930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a9aae-8445-40b1-84e9-35f375af4a87 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:34.912210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a9aae-8445-40b1-84e9-35f375af4a87 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:34.912669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a9aae-8445-40b1-84e9-35f375af4a87 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:34.913787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 174/348] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:34.914467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a9aae-8445-40b1-84e9-35f375af4a87 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:34.969274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3d7e2-f619-4c21-bee3-7003fe026950 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:35.009612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:35.011421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2654f05-447f-431d-baba-e1515e40045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:35.012048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654f05-447f-431d-baba-e1515e40045c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.012325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654f05-447f-431d-baba-e1515e40045c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.012628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654f05-447f-431d-baba-e1515e40045c None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.013283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2654f05-447f-431d-baba-e1515e40045c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:35.013590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2654f05-447f-431d-baba-e1515e40045c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:35.014989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2654f05-447f-431d-baba-e1515e40045c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:35.032866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 175/349] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:35.034293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2096ff-a4fd-4a25-8033-1988a6925d58 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.034585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2096ff-a4fd-4a25-8033-1988a6925d58 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.034859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2096ff-a4fd-4a25-8033-1988a6925d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.046808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a9aae-8445-40b1-84e9-35f375af4a87 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:35.058018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8b2096ff-a4fd-4a25-8033-1988a6925d58 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:35.059246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b2096ff-a4fd-4a25-8033-1988a6925d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:35.091683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:35.092586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.092863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.093133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.093949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:35.094577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:35.096237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:35.114045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 175/350] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:35.114887 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:35.151465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 176/351] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:35.152825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2096ff-a4fd-4a25-8033-1988a6925d58 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:35.225438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:35.253463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7d016-ea04-46ca-bb3c-ba016561e531 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:35.295191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2096ff-a4fd-4a25-8033-1988a6925d58 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:35.320780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:35.323492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcda40-afde-48ab-983c-461521920491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:35.324099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcda40-afde-48ab-983c-461521920491 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.324372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcda40-afde-48ab-983c-461521920491 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.324705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcda40-afde-48ab-983c-461521920491 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.325359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcda40-afde-48ab-983c-461521920491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:35.326797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcda40-afde-48ab-983c-461521920491 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:35.362294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:35.362900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.363238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.363510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.364156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:35.365608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:35.457562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 176/352] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:35 2022] POST /identity/v3/users => generated 248 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:35.458401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcda40-afde-48ab-983c-461521920491 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:35.495575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 177/353] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:35 2022] POST /identity/v3/users => generated 248 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:35.605570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcda40-afde-48ab-983c-461521920491 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:35.644625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e55308-78f5-4d8e-91c7-f7f1dc2926cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:35.645279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55308-78f5-4d8e-91c7-f7f1dc2926cc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.645559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55308-78f5-4d8e-91c7-f7f1dc2926cc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.645831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55308-78f5-4d8e-91c7-f7f1dc2926cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.659018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e55308-78f5-4d8e-91c7-f7f1dc2926cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:35.660518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e55308-78f5-4d8e-91c7-f7f1dc2926cc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-24e55308-78f5-4d8e-91c7-f7f1dc2926cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:35.677235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:35.678204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:35.679071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:35.679071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:35.679071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:35.679071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 177/354] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:35.684831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:35.691942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed8ab-fc1f-4473-b836-26d88abda49a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.692286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed8ab-fc1f-4473-b836-26d88abda49a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.692522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed8ab-fc1f-4473-b836-26d88abda49a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.694222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 178/355] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:35.699911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42123d05-a46d-4ac1-967e-4ffd7051d669 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.700249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42123d05-a46d-4ac1-967e-4ffd7051d669 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.700529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42123d05-a46d-4ac1-967e-4ffd7051d669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.720400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-42123d05-a46d-4ac1-967e-4ffd7051d669 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:35.721634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-42123d05-a46d-4ac1-967e-4ffd7051d669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:35.761344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:35.809559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 179/356] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:35.814661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591494c-bbb5-419a-8b82-18f2b7c7a506 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:35.825869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:35.851200 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:35.852364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:35.852709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:35.852980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:35.853628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:35.853929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:35.855303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:35.868023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 178/357] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:35.873712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42123d05-a46d-4ac1-967e-4ffd7051d669 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:35.986593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42123d05-a46d-4ac1-967e-4ffd7051d669 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.025215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.025745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.026017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.026283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.026935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.028351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.111648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.130508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 180/358] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:35 2022] POST /identity/v3/users => generated 249 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:22:36.277289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230aa92-f816-4c4b-9d52-5edafa2b267b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.317076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.317687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.317962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.318222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.318897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.320248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.407941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:22:36.407941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:22:36.407941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [parameters: {'id': 'd48160aca9084538baf53b3140d70db3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:22:36.407941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:22:36.414859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:22:36.415692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:22:36.417289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:22:36.418160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:22:36.419015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:22:36.419827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'id': 'd48160aca9084538baf53b3140d70db3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:36.421545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 07:22:36.423693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:36.425727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 179/359] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Nov 2 07:22:36 2022] POST /identity/v3/roles => generated 144 bytes in 305 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:36.425861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.463695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.569232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75165-2cb4-4a6a-a8fc-43434483ed0a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.611440 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4fac8-6cf0-4203-9a4b-fca5b9d53630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.612083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4fac8-6cf0-4203-9a4b-fca5b9d53630 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.612360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4fac8-6cf0-4203-9a4b-fca5b9d53630 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.612669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4fac8-6cf0-4203-9a4b-fca5b9d53630 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.628285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4fac8-6cf0-4203-9a4b-fca5b9d53630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-c9f4fac8-6cf0-4203-9a4b-fca5b9d53630 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:36.634192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:36.636340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:36.638308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 181/360] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:36.644712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:36.699520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:36.781422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef8a7-a3b3-4796-887a-d66ab660c3a5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:36.829546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3c86f-9933-4ef7-82a6-0a33d35b6caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:36.830154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3c86f-9933-4ef7-82a6-0a33d35b6caf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:36.830396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3c86f-9933-4ef7-82a6-0a33d35b6caf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:36.830604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3c86f-9933-4ef7-82a6-0a33d35b6caf None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:36.831270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3c86f-9933-4ef7-82a6-0a33d35b6caf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:36.831579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3c86f-9933-4ef7-82a6-0a33d35b6caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:36.832967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3c86f-9933-4ef7-82a6-0a33d35b6caf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:36.843655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 180/361] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:37.627947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62fca-efe8-4053-8571-e68d6ff89340 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:37.628944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62fca-efe8-4053-8571-e68d6ff89340 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:37.629441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62fca-efe8-4053-8571-e68d6ff89340 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:37.630980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 182/362] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:37.646281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530137-2562-4235-9b98-e03c49815ad1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:37.646561 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530137-2562-4235-9b98-e03c49815ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:37.646835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530137-2562-4235-9b98-e03c49815ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:37.668627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cc530137-2562-4235-9b98-e03c49815ad1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:37.669853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc530137-2562-4235-9b98-e03c49815ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:37.740547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 181/363] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:38.017285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62fca-efe8-4053-8571-e68d6ff89340 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:38.074523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175a279-e114-42ce-8557-245be235bff3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.075474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175a279-e114-42ce-8557-245be235bff3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.076108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175a279-e114-42ce-8557-245be235bff3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.078746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 182/364] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:38.082891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181310-1a71-485c-8cf0-ae295aa756b7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.083394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181310-1a71-485c-8cf0-ae295aa756b7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.083861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181310-1a71-485c-8cf0-ae295aa756b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.124875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:38.130123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-13181310-1a71-485c-8cf0-ae295aa756b7 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:38.138335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-13181310-1a71-485c-8cf0-ae295aa756b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:38.150040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62fca-efe8-4053-8571-e68d6ff89340 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:38.153783 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:38.202642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 183/365] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:38.216810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:38.217720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.218140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.218557 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.241330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:38.246596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:38.247473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:38.248268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:38.250475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 183/366] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:38.256144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181310-1a71-485c-8cf0-ae295aa756b7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:38.364268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181310-1a71-485c-8cf0-ae295aa756b7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:38.399787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:38.400390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.400689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.400953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.401610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:38.401903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:38.403267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:38.411730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 184/367] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:38.417001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:38.521715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:38.548791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:38.602705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5145-2046-4b98-8bbb-45fe00d092fa None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:38.670765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:38.671384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.671613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.672419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.685099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:38.686625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:38.694597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:38.704176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:38.705125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:38.705966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:38.705966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:38.705966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:38.712618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 184/368] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:38.713501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:38.726125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7da8e4-59cb-48b1-b002-76dff8c6cede None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:38.765495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45a23-3e3b-4218-a3b8-6687bce8c9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:38.766457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45a23-3e3b-4218-a3b8-6687bce8c9bf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.766960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45a23-3e3b-4218-a3b8-6687bce8c9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.767474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45a23-3e3b-4218-a3b8-6687bce8c9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.778457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d45a23-3e3b-4218-a3b8-6687bce8c9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-40d45a23-3e3b-4218-a3b8-6687bce8c9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:38.784045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:38.785183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:38.786336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 185/369] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:38.790991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b506-4ede-49dd-b0a9-0b3b6f825e8f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.791272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b506-4ede-49dd-b0a9-0b3b6f825e8f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.791538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97b506-4ede-49dd-b0a9-0b3b6f825e8f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.792941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 186/370] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:38.793817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942b4c-89b2-4f14-be5e-cc90a0e2c5cc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.794093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942b4c-89b2-4f14-be5e-cc90a0e2c5cc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.794359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942b4c-89b2-4f14-be5e-cc90a0e2c5cc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.796068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 187/371] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:38.796235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942b4c-89b2-4f14-be5e-cc90a0e2c5cc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:38.838215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec224c6c-770b-40ac-8786-2d10050b9730 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:38.878115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b86c0b-7130-4d02-a104-018f84f1466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:38.878720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b86c0b-7130-4d02-a104-018f84f1466c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.879170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b86c0b-7130-4d02-a104-018f84f1466c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.879440 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b86c0b-7130-4d02-a104-018f84f1466c None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.880475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b86c0b-7130-4d02-a104-018f84f1466c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:38.880756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b86c0b-7130-4d02-a104-018f84f1466c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:38.881303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:38.882792 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b86c0b-7130-4d02-a104-018f84f1466c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:38.898515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 185/372] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:38.899869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc336e6-b93e-47e4-8f9c-72872f7e1ce5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.900152 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc336e6-b93e-47e4-8f9c-72872f7e1ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.900418 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc336e6-b93e-47e4-8f9c-72872f7e1ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.904878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942b4c-89b2-4f14-be5e-cc90a0e2c5cc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:38.918523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8bc336e6-b93e-47e4-8f9c-72872f7e1ce5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:38.919693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8bc336e6-b93e-47e4-8f9c-72872f7e1ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:38.945116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d0220-6217-4664-92d2-a3e4737373b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:38.946912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d0220-6217-4664-92d2-a3e4737373b8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.947801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d0220-6217-4664-92d2-a3e4737373b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.948551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d0220-6217-4664-92d2-a3e4737373b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.949566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d0220-6217-4664-92d2-a3e4737373b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:38.950199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d0220-6217-4664-92d2-a3e4737373b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:38.951625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d0220-6217-4664-92d2-a3e4737373b8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:38.960612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 188/373] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:38.961951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ce80-f0dc-451b-866c-7828a27666c6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:38.962229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ce80-f0dc-451b-866c-7828a27666c6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:38.962495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173ce80-f0dc-451b-866c-7828a27666c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:38.980328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a173ce80-f0dc-451b-866c-7828a27666c6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:38.980531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:38.981628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a173ce80-f0dc-451b-866c-7828a27666c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:38.994439 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 186/374] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:39.001548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc336e6-b93e-47e4-8f9c-72872f7e1ce5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.056461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 189/375] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:39.056461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ce80-f0dc-451b-866c-7828a27666c6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.171425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc336e6-b93e-47e4-8f9c-72872f7e1ce5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.186235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.230937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173ce80-f0dc-451b-866c-7828a27666c6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.258057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.258693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.258970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.259237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.273574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.274005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.274282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.274585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.276102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:39.277593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:39.295247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:39.297010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:39.298307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:39.299347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:39.300285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:39.303995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 187/376] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Nov 2 07:22:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:39.305416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:39.318530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:39.319680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:39.320758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:39.320758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:39.320758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:39.321811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 190/377] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:39.326508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.367835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.423317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605a656-349e-4fc1-b4de-62484e707186 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.445374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a82a5-8d93-4eb3-a0d3-fe4fcc87b66b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.460283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.461659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.462070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.462487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.469234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.474145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:39.480073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:39.485070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:39.485890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:39.486508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.486508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.486508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.486707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 188/378] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:39.486779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.486779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:39.486897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.486969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:39.486969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:39.522693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 191/379] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:39.524068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.596457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a191208-d70e-4a27-8f31-9267b0e98c33 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.606357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.628192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13787999-e728-48b1-9a15-d17ce766d0ee None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.633190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.633808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.634082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.634348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.635150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:39.635881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:39.638667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:39.652298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 189/380] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:39.652298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.673560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.674195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.674475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.674744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.685450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:39.690392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:39.691289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:39.692367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 192/381] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:39.697454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.740491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.758808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9173-401f-4344-84f7-0c48878d263c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.793018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.793613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.793889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.794157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.794812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:39.795109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:39.796477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:39.799072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c8672-db64-4d37-a7b0-bedaf521e3a1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.804170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 190/382] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:39.805047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.834388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.835134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.836491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.836797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.837069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.847119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:39.848617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:39.863211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:39.864139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:39.865610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:39.865610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:39.865610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:39.865610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 193/383] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:39.865610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.907078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d7c6d-e1ab-496e-aaca-a28cabec5f04 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:39.939010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b74f0-48d3-493d-97d3-70aa6c5e4c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:39.939630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b74f0-48d3-493d-97d3-70aa6c5e4c8d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.939909 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b74f0-48d3-493d-97d3-70aa6c5e4c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.940180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b74f0-48d3-493d-97d3-70aa6c5e4c8d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.948413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b74f0-48d3-493d-97d3-70aa6c5e4c8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:39.949879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b74f0-48d3-493d-97d3-70aa6c5e4c8d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:39.957426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-746b74f0-48d3-493d-97d3-70aa6c5e4c8d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:39.960881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:39.962359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:39.963270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 191/384] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:39.963838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ba647-24aa-41d5-a7a1-548462b8c42a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:39.963913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ba647-24aa-41d5-a7a1-548462b8c42a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:39.964230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ba647-24aa-41d5-a7a1-548462b8c42a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:39.965398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 192/385] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:39.966084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ba647-24aa-41d5-a7a1-548462b8c42a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:39.970782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8aed4-2758-4d63-9633-f23d9debefe6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.004394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.004949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.005225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.005492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.006142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.006439 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.008350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.016090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 194/386] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.016899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.059114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.069480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ba647-24aa-41d5-a7a1-548462b8c42a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.102486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.103079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.103350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.103612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.114180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.115184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7f42d-d07c-4f2f-8f91-130a94a11019 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.116078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:40.133940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.135082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:40.136117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:40.136117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.136117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:40.136117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 193/387] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.136117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.158095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9994-2e44-4c4b-8ed5-b10a4b95132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.161950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9994-2e44-4c4b-8ed5-b10a4b95132b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.161950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9994-2e44-4c4b-8ed5-b10a4b95132b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.161950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9994-2e44-4c4b-8ed5-b10a4b95132b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.161950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9994-2e44-4c4b-8ed5-b10a4b95132b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.161950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9994-2e44-4c4b-8ed5-b10a4b95132b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.161950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d9994-2e44-4c4b-8ed5-b10a4b95132b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.173679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 195/388] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.174816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ed49-0045-4995-9ee2-ed1a7008374d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.175085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ed49-0045-4995-9ee2-ed1a7008374d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.175350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6ed49-0045-4995-9ee2-ed1a7008374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.192697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0ad6ed49-0045-4995-9ee2-ed1a7008374d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:40.193867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0ad6ed49-0045-4995-9ee2-ed1a7008374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:40.204026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.246285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02324c-052e-4cec-8839-a2f19d411f79 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.260492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 196/389] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:40.261242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ed49-0045-4995-9ee2-ed1a7008374d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.296878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.297474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.297748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.298010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.298726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.299022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.300870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.334701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.338968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 194/390] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.339912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.364711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6ed49-0045-4995-9ee2-ed1a7008374d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.406288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.406910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.407182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.407456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.418701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.420138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.422862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:40.437299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.445111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:40.446539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:40.446539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.446539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:40.446539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 197/391] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.446539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.447852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537adc95-31a4-484a-bb5a-52ab8e22100f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.484578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.485325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.485615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.485877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.486504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.486805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.488210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.500336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 195/392] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.505356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.544028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605548e2-03ea-41e6-b47c-fa7e6f2be5f5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.564247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.577691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.580985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.580985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.580985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.585772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.587210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:40.598657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.599674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 198/393] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.606021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.606685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d35be-59b9-4c2c-af12-0e3f87add030 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.637738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.638352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.638626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.638897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.649135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.650581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.658274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:40.665174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.666191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:40.667064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:40.667064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.667064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:40.667064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 196/394] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.667064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.701748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487d0d-f5e9-441a-8456-24e5a2863a15 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.735991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.736619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.736893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.737163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.737794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.738094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.739462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.751577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 199/395] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.752596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.767208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914c5d0-e6c3-4383-a263-54be0d5940ad None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.779609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.800532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.801111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.801386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.801658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.809498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.810923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:40.822803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.823884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 197/396] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.825015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.858544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f627df-812a-49b8-83ab-aca647f1d8da None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.874375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:40.891492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.892114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.892392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.892691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.902831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.904282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:40.919427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:40.920461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:40.921497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:40.921497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:40.921497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:40.921976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d95982-6b36-4271-9070-ab64ef8de243 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:40.923014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 200/397] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:40.924112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:40.959486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:40.960079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:40.960357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:40.960653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:40.961866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:40.962166 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:40.963582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:40.981179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 198/398] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:40.981962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.012293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.026888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2b30-b6b2-47b3-9f00-4c999eca330a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.060128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.060683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.060959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.061224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.061853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:41.062149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.063514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.075711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 201/399] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.076501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.083789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ca90-4e47-4b1c-abfd-71fc0f8dbf4e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.103827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.118642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.119269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.119550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.119869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.127431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.128985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:41.141097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:41.142185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 199/400] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:41.143115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.179321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f37f1-5b33-4ebe-ba08-c5b4262cc8a0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.227920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.228542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.228814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.229081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.229802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:41.230104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.231529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.237940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.246181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b543a83-f163-4469-bea1-d1c3d0dbf885 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.248640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 202/401] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.253473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.280531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.281458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.281813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.282159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.282870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:41.283244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.284714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.296448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 200/402] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.297320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.332409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.347126 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2b30a-def9-4e76-8275-795c95519190 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.384536 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.385603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.385881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.386150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/e5e6e7eee9ea4be093bb283594f7651c/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.401162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=e5e6e7eee9ea4be093bb283594f7651c, role_id=fd0ef19bc1bb4e4fa93c50d4be28ba9a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.402425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4368f12-070d-4556-abff-cad6f91864aa None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.402614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.436235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.436878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.437150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.437418 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.443943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.445900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:41.457198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:41.458258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 201/403] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:41.459264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.470358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 203/404] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:41 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/e5e6e7eee9ea4be093bb283594f7651c/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:41.471483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.474218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.569989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d406c25-8a26-4397-af36-35da7426cbc9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.586653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e96d7a-d82b-4772-863e-0c911735c31b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.608954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.609579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.609858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.610132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.610878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:41.611182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.612690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.626840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.627734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.628149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.629290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.632319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 202/405] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.633778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.637911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.647262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.648813 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:41.665454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:41.666575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:41.672037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:41.672037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:41.672037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:41.672037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 204/406] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:41.672037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.713619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.742829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e009-2d30-411f-9512-2dd37da765dc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.779062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539031-1dbb-4e8a-8c6f-05662769742e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:41.779251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.779851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.780125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.780389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.781319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.782739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.815539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:41.816142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:41.816418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:41.816719 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:41.817411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:41.817714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:41.819144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:41.836967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 205/407] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:41.837704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.864770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 203/408] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:41 2022] POST /identity/v3/users => generated 247 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:41.864770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:41.903588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:41.973802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072534e4-7783-4990-8daf-55aae2731322 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.016489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01ea1-a61d-458a-a047-f0fab2ad165e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.017955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.018675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.019080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.019426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.031256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.032763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.050952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:42.051268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:42.052229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:42.053154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:42.053154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:42.053154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:42.057605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 206/409] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:42.058391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.072094 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.073111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.073486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.074180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.074927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:42.075324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.076825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.092283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 204/410] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.093166 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.188785 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:42.192211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02224-059a-441a-8a66-f2ef5b3b4909 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.221303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63c7d-6919-49ff-8561-f870f1868e0b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.229925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.230707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.231057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.231397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/12ea11e310224282b38a0822fbbcf40a/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.249817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=12ea11e310224282b38a0822fbbcf40a, role_id=fd0ef19bc1bb4e4fa93c50d4be28ba9a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.251480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.266091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.266938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.267449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.267901 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.268799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:42.269270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.270811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.283747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 205/411] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.284809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.341268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 207/412] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:42 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/12ea11e310224282b38a0822fbbcf40a/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:42.342666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.348450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:42.487439 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb60b9e-9e6a-4a5a-8de8-bf22ec73be43 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.546786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beaf94-fee9-4f93-8683-7307cebcbe33 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.587747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.588504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.588849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.589189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.592365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.592365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.592365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.592365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.600127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.602181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.602291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.603709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:42.615747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:42.616646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:42.617560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 208/413] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:42.626619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:42.632156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:42.633910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:42.635770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:42.641407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 206/414] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:42.641407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.643432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:42.833438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff155885-80f7-48b7-bbbf-f6c7fd868709 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.836522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73966-18ba-4d5a-81bc-1b608a144058 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:42.854167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:42.909523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.910136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.910417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.910688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.911389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:42.911690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.913177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.917460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:42.918068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:42.918345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:42.918615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:42.919308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:42.919611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:42.921077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:42.942050 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 209/415] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.950264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:42.951319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 207/416] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:42.965486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:43.053518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:43.076180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ddf73-7c15-44c4-992c-1e2bf1b485fe None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:43.128915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f75de-8bf9-48c5-a4a3-3d36da5ccc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:43.129659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f75de-8bf9-48c5-a4a3-3d36da5ccc68 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:43.130004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f75de-8bf9-48c5-a4a3-3d36da5ccc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:43.140625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f75de-8bf9-48c5-a4a3-3d36da5ccc68 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/32ee11e2d4324bb7a9b83c8fd2b98bb7/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:43.160108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f75de-8bf9-48c5-a4a3-3d36da5ccc68 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=32ee11e2d4324bb7a9b83c8fd2b98bb7, role_id=fd0ef19bc1bb4e4fa93c50d4be28ba9a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:43.162964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f75de-8bf9-48c5-a4a3-3d36da5ccc68 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:43.189833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f899fe-7955-4fd5-adb3-1737429e8938 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:43.226124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9e5a0-b4d7-4c8e-a5cf-7a090dd5b196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:43.226818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e5a0-b4d7-4c8e-a5cf-7a090dd5b196 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:43.227096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e5a0-b4d7-4c8e-a5cf-7a090dd5b196 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:43.227361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e5a0-b4d7-4c8e-a5cf-7a090dd5b196 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/60e4cc87886d4b7788864eaf94334e22/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:43.243894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9e5a0-b4d7-4c8e-a5cf-7a090dd5b196 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=60e4cc87886d4b7788864eaf94334e22, role_id=fd0ef19bc1bb4e4fa93c50d4be28ba9a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:43.245375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9e5a0-b4d7-4c8e-a5cf-7a090dd5b196 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:43.270570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 210/417] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:42 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/32ee11e2d4324bb7a9b83c8fd2b98bb7/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:43.342334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 208/418] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:42 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/60e4cc87886d4b7788864eaf94334e22/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:43.971392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416803-0e44-4321-9b80-d8713be18883 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:43.971766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416803-0e44-4321-9b80-d8713be18883 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:43.971943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59416803-0e44-4321-9b80-d8713be18883 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:43.973446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 211/419] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:43.979022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834fbd-7d10-4f8e-8ad1-ffe5d7585f8a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:43.979466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834fbd-7d10-4f8e-8ad1-ffe5d7585f8a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:43.979635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd834fbd-7d10-4f8e-8ad1-ffe5d7585f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.001449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bd834fbd-7d10-4f8e-8ad1-ffe5d7585f8a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:44.002646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bd834fbd-7d10-4f8e-8ad1-ffe5d7585f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:44.020049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.092611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 209/420] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:44.441105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416803-0e44-4321-9b80-d8713be18883 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.547731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8592-a7e6-4f98-8b05-c37391e4fb80 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.548017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8592-a7e6-4f98-8b05-c37391e4fb80 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.548297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8592-a7e6-4f98-8b05-c37391e4fb80 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.549927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 210/421] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:44.557635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6300-e1b9-475b-a53c-74695c589892 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.557917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6300-e1b9-475b-a53c-74695c589892 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.558182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa6300-e1b9-475b-a53c-74695c589892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.574743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59416803-0e44-4321-9b80-d8713be18883 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.593493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d6fa6300-e1b9-475b-a53c-74695c589892 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:44.594695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d6fa6300-e1b9-475b-a53c-74695c589892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:44.599340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.619550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:44.620602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.621038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.621462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.633548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:44.639074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:44.639954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:44.640817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:44.642066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 212/422] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:44.649872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.760602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70a4dc-32ac-4aca-a093-01f0b6d3abee None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.798605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:44.799542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.800035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.800545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.801555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:44.802070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:44.803706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:44.812705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 213/423] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:44.816515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 211/424] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:44.820078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:44.902301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:44.947220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ba41f-080d-41e0-a860-aa679bc49cac None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.947504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ba41f-080d-41e0-a860-aa679bc49cac None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.947782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ba41f-080d-41e0-a860-aa679bc49cac None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.949403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 212/425] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:44.954578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5e4ff-0632-4c05-8720-8917fb8d826f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:44.954863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5e4ff-0632-4c05-8720-8917fb8d826f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:44.955144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5e4ff-0632-4c05-8720-8917fb8d826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:44.972038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcf820-a476-45fc-8250-a8b089be2f65 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:44.985665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-53c5e4ff-0632-4c05-8720-8917fb8d826f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:44.986864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-53c5e4ff-0632-4c05-8720-8917fb8d826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:45.030843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.031388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.031660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.031923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.043902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.045415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:45.059592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:45.060539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:45.061420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:45.061420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:45.061420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:45.061420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 214/426] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:45.066349 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.122593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 213/427] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:45.183113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5e4ff-0632-4c05-8720-8917fb8d826f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.191632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.247798 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.266243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f09b3-0ed3-4130-9fa5-b6548c9cd949 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.286330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5e4ff-0632-4c05-8720-8917fb8d826f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.324126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.324788 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.325129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.325752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.337361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:45.342864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:45.343762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:45.344606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 214/428] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:45.349926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.361125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.361733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.362011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.362280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.362925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:45.363223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.364618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.390682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 215/429] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:45.395891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.424838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.459753 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1747-e255-4d41-8484-e81b97c0d29d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.501625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.502500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.502828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.503105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.503814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:45.504118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.506214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.517722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 215/430] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:45.521194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.554093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba42bd-54e8-45f3-9664-c54ffa461330 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.600622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.601306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.602054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.602330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.612379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.614839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.625531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c08e25-5bf2-48e2-a056-8494b2116106 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:45.635233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:45.636148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:45.637163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:45.637665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 216/431] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:45.639015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.661546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.662137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.669728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:45.694161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:45.694906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:45.696263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 216/432] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:45.697182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.773189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55644e-0dbf-4044-aa83-d0c00c802cb8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.806138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5819baf-a1b6-4b79-bba0-e8576b5c9828 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.816601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.817907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.818468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.818913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.834427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.836730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.842159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:45.842869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:45.843242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:45.843574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:45.844355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:45.844754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:45.846437 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:45.855479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:45.856415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:45.857304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:45.857304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:45.857304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:45.862545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 217/433] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:45.862545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.874890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 217/434] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:45.876109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:45.933694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.945120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:45.984421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107970f-d3ec-459d-a619-8ddb37cae54f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:45.993409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecb316-84e1-41f2-8141-da7ee908c78c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.020630 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.021399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.022010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.022287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.023124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:46.023424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.024917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.029644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3d103-d3a6-406b-bae9-1fb1be9796a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.030254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3d103-d3a6-406b-bae9-1fb1be9796a0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.030783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3d103-d3a6-406b-bae9-1fb1be9796a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.031063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3d103-d3a6-406b-bae9-1fb1be9796a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.031752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3d103-d3a6-406b-bae9-1fb1be9796a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:46.031997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3d103-d3a6-406b-bae9-1fb1be9796a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.036849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3d103-d3a6-406b-bae9-1fb1be9796a0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.036974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 218/435] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.036974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.047536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 218/436] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.048941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4c87-3573-4e84-a6c3-78a0f5833594 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.049196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4c87-3573-4e84-a6c3-78a0f5833594 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.049463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4c87-3573-4e84-a6c3-78a0f5833594 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.050636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 219/437] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:46.051400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c4c87-3573-4e84-a6c3-78a0f5833594 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.144679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf3f5-80df-4a25-b348-bc03378d5016 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.157362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c4c87-3573-4e84-a6c3-78a0f5833594 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.164841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.172003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.179710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e61e3-7fed-41c4-9416-3cbe8f673d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.180308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e61e3-7fed-41c4-9416-3cbe8f673d0d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.180610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e61e3-7fed-41c4-9416-3cbe8f673d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.180876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e61e3-7fed-41c4-9416-3cbe8f673d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.191200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6657cd-02f7-4279-bcbd-fc3a5404bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.192119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6657cd-02f7-4279-bcbd-fc3a5404bbaa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.192400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6657cd-02f7-4279-bcbd-fc3a5404bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.192695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6657cd-02f7-4279-bcbd-fc3a5404bbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.202932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6657cd-02f7-4279-bcbd-fc3a5404bbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.204367 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6657cd-02f7-4279-bcbd-fc3a5404bbaa None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-fc6657cd-02f7-4279-bcbd-fc3a5404bbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:46.219276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:46.225335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 220/438] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d4a5-4320-44fb-a167-8f8d1d452c8e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d4a5-4320-44fb-a167-8f8d1d452c8e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467d4a5-4320-44fb-a167-8f8d1d452c8e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 221/439] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:46.227030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d4a5-4320-44fb-a167-8f8d1d452c8e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.251055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e61e3-7fed-41c4-9416-3cbe8f673d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.252542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e61e3-7fed-41c4-9416-3cbe8f673d0d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.323205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467d4a5-4320-44fb-a167-8f8d1d452c8e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.349109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 219/440] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:46.350166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab411684-8bc6-46bf-8afc-b3f59d43736b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.350446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab411684-8bc6-46bf-8afc-b3f59d43736b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.350720 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab411684-8bc6-46bf-8afc-b3f59d43736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.358968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.359590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.359870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.360140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.367925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.368273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ab411684-8bc6-46bf-8afc-b3f59d43736b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:46.369363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.369459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ab411684-8bc6-46bf-8afc-b3f59d43736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:46.380473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:46.381416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 222/441] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:46.382313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.395645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.402971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.439201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 220/442] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:46.440406 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c501a-ecae-4efa-affd-c512457fcf04 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.440722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c501a-ecae-4efa-affd-c512457fcf04 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.440996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c501a-ecae-4efa-affd-c512457fcf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.464121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c30c501a-ecae-4efa-affd-c512457fcf04 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:46.465329 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c30c501a-ecae-4efa-affd-c512457fcf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:46.494577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123bf1-a6a1-4a43-b885-07532ec83d17 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.529568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.530165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.530447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.530965 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.531594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:46.531941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.533289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.544452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 221/443] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:46.544452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c501a-ecae-4efa-affd-c512457fcf04 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.559126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 223/444] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.560173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.638821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.642883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.653597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c501a-ecae-4efa-affd-c512457fcf04 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.672747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ad3d9-dc9f-4d62-9897-9aef15b9e987 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.691676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.692466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.692859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.693202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.707708 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.709228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.716723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.717534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.718381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.718831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.720012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:46.720514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.722102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:46.724208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:46.725262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:46.726355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:46.726355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:46.726355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:46.729675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 222/445] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:46.730541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.745429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 224/446] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:46.746800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.835291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8971d85-b96d-4767-9648-df9bbbbf177a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.854141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f651c-9871-4fa1-ba95-e1e0ffd05ba0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:46.868769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.869382 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.869656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.869918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.877685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:46.879119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:46.881603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.887993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:46.888633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:46.888957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:46.889170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:46.891065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:46.892051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 07:22:46.892988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:46.893504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:46.893572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 223/447] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:46.893572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.900425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:46.905345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:46.906688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:46.907668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 225/448] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:46.909196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:46.996356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0551-7eb8-45e9-b821-b48519af7312 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.005049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e4e9-c7ec-436a-ae77-219666e00515 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.029022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.029620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.029894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.030160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.031060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.031360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.032743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.038741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.039349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.039628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.039896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.044627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 224/449] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.045410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.050097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.051531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:47.066319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:47.067498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:47.068601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:47.068601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:47.068601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:47.068601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 226/450] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:47.068601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.107760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.115920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.154416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346487d-2881-40df-93b6-ba5e734bfb6c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.169680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3370ee5-67e6-4d6d-b8ed-7ed9b240ee76 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.190514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.191140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.191417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.191686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.202290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:47.203132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.203717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.203991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.204256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.204993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.205288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.206700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:47.207038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:47.208059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 225/451] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:47.209262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.225426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 227/452] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.226784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.308515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea11f8-2048-4af6-815b-aca727c1efd6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.324051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bad889-a5ea-4028-b68f-17c72a246bdc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.327641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.331164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.341146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.341787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.342064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.342337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.342987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.343289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.344697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.353202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 226/453] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.353995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.360832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.361460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.361734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.361999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.369180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.370719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:47.381747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:47.384424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 228/454] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:47.385315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.465323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c29bd-84a0-4906-b544-2e2ec72d1910 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.486059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33196d-ffa6-43a5-a8f5-4323cf873646 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.499504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.500105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.500380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.500674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.501317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.501615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.502975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.513818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 227/455] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.513818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.521163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.521764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.522038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.522303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.522980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.523275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.524695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.532756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 229/456] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.533514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.560970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.565998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.621311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117547-c968-46f5-8cfc-ba90732b8d1d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.629954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97073a8e-9ea1-4c2d-bf10-59fe750001fa None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.653834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.654426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.654700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.654969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.663103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.664254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.664550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.664817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.674955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.676373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:47.690334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:47.691380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:47.692257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:47.692257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:47.692257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:47.692257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 230/457] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:47.692257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.724036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.725457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.765620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.772699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.791891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf44696-4141-4b27-8d3b-d7ff8ddb2132 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.821801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 228/458] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:47.822665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.824066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.824691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.824974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.825246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.825994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:47.826537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.828693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.842116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 231/459] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:47.842899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.922589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0562b-ca87-4544-86b9-7b28d71f5e6a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.943426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2482e-6fbc-4292-baba-703860ad5b76 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:47.955844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.956473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.956751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.957016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.963978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.965433 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:47.976172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:47.977086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:47.977953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:47.978538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:47.978639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 229/460] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:47.978709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:47.978774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:47.978838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:47.978838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:47.983947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.990152 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:47.992246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:47.993728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:48.008421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:48.009765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:48.011061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:48.011061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:48.011061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:48.011061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 232/461] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:48.011061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.083888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f36d1-1df0-427a-9e69-27984440e49e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.106345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022688e-d594-49ac-b41d-b2a45652013a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.117528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.118216 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.118542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.118870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.119571 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:48.119929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.121381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.133712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 230/462] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:48.134546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.145074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.145697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.146024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.146238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.157487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.158924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:48.172891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:48.173964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:48.174993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:48.174993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:48.174993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:48.178803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 233/463] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:48.179602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.194576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:48.224325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:48.232594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db505e3b-f54c-4a1e-a236-a17b257b89c2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.265926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.266523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.266802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.267068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.267778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] RBAC: Adding query filter params (role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=e5e6e7eee9ea4be093bb283594f7651c) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:48.268081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.269530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.275652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 231/464] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/role_assignments?user.id=e5e6e7eee9ea4be093bb283594f7651c&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:48.276409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.277357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75353d82-6f9c-42ef-b8c5-21d0f0f92847 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.323809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.324459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.324729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.324998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.325698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:48.326003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.327480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.345999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 234/465] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:48.345999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.401706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af462d80-ef24-488a-b262-71592ceb96fd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.433237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:48.443758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.443758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.444116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.444485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.445758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:48.446124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.448085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.461816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 232/466] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:48.462931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.465380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d71b8-c8ee-4c7b-b7d0-b456339e97f6 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.468635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:48.503551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.504105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.504379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.504680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.513315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.514916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:48.529111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:48.530019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:48.531234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 235/467] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:48.531821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.579283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c00515-14f9-42b1-8194-2bd9f00c95ce None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.617347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.618161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.618269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.618472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.619106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:48.619517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.621018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.637560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849fdfb-02f7-479d-9c7f-eb41d9b7a7ad None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.637724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 233/468] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:48.638538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.673281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.674274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.674547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.674812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/7037b6179bdd434db3780d97d20060bd/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.689397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:48.689868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=7037b6179bdd434db3780d97d20060bd, role_id=fd0ef19bc1bb4e4fa93c50d4be28ba9a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.691204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.743615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bb360-a428-46c2-8dc0-8b80e7545cd2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.747498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 236/469] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:48 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/7037b6179bdd434db3780d97d20060bd/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:48.761512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.785265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.786011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.786290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.786556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.789266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:48.798885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.801075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:48.817926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:48.819125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 07:22:48.820286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:48.822652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 234/470] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:48.823655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.902444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afb20d-c383-4055-81b6-c017b99d14d3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.940761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:48.941601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:48.942016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:48.942458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:48.943181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:48.943482 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:48.945054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:48.964114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 237/471] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:48.964862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:48.967504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177ee6-8414-45d9-bc6d-0029517e6712 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:48.975608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.008183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:49.008880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:49.009151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:49.009425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:49.016264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:49.017658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:49.030188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:49.031399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:49.032271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 235/472] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:49.036755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:49.066241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.109075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef9319-def5-4b04-88fd-d57f80152f63 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:49.145946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c7f906-e658-49e2-8ba7-945000d24926 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:49.159021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:49.159632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:49.159910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:49.160181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:49.160949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:49.161253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:49.162677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:49.186191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 238/473] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Nov 2 07:22:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:49.186191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:49.246279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:49.247211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:49.247849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:49.248293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:49.295063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.324595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea627e-462a-450c-a8d0-f090b3d1af14 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:49.334320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:49.336657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:49.356220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.362304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:49.363045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:49.363413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:49.363777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:49.364736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:49.365081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:49.366656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:49.383436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 239/474] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:49.383436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:49.482260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 236/475] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:49.483558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:49.496550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997041-0e13-47ab-8843-ed6907915e20 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:49.532055 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:49.533043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:49.533043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:49.533389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:49.562120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.603034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56188-1c06-4a3e-9b17-134c3a6caecd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:49.606645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.620281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:49.622957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:49.648530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:49.649423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:49.650230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:49.650978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:49.652306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] RBAC: Adding query filter params (role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=12ea11e310224282b38a0822fbbcf40a) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:49.653006 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:49.654759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:49.669114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 237/476] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:49 2022] GET /identity/v3/role_assignments?user.id=12ea11e310224282b38a0822fbbcf40a&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:49.669114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:49.800005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 240/477] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:49.802951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:49.885874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cac11-be6b-40e3-b22a-f7d556baa65f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:49.920716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.927569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:49.927745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:49.927969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:49.928239 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:49.939258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:49.946999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:49.952378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:49.958657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:49.959569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:49.961142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:49.961142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:49.961142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:49.961142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 238/478] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:49.966065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:49.969604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebccb012-8fc3-4de4-b9bf-399382aa29bb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.007925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.008972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.009462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.009930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.021597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.023965 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:50.041366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:50.042311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:50.043180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:50.043180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:50.043180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:50.045326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 241/479] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:50.051007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:50.077288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e32445-8ba1-4bb4-9663-194559b73669 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.113049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.113647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.113924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.114245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.114881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:50.115185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.117135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.132245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 239/480] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:50.138201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:50.169837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c17c-7d14-47b3-a828-41945ffaa061 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.185479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:50.208562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.209305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.209679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.210044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.211395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:50.211785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.213260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.231980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 242/481] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:50.233145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:50.235964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:50.246014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba501cab-a257-4422-bbda-6479a65ed68d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.283080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.283362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.283679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.283956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.291055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.292502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:50.303895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:50.305015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:50.306164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 240/482] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:50.310967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:50.345472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73b670-15fd-45bb-8b89-d00a381055fd None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.390232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.390985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.391348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.391702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.408794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.410476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.418861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ee650-da7f-49ab-b58e-44cde843aa4d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:50.439287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:50.440396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:50.441564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:50.442140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:50.442228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 243/483] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:50.446954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:50.493010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.493616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.493898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.494169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.494865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:50.495448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.498042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.517498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 241/484] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:50.523917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:50.555127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:50.596379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeba67-4343-4e97-b69e-0329921f256c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.633744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be5c44-2a45-440e-832e-9337ef5f8c4a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.634039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e96f32-2490-4fb2-bc5a-2b90e168add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.634603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96f32-2490-4fb2-bc5a-2b90e168add4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.634938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96f32-2490-4fb2-bc5a-2b90e168add4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.635357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96f32-2490-4fb2-bc5a-2b90e168add4 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.636209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96f32-2490-4fb2-bc5a-2b90e168add4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:50.636626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96f32-2490-4fb2-bc5a-2b90e168add4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.638170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96f32-2490-4fb2-bc5a-2b90e168add4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.656323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 244/485] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:50.657755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12bde-3c6d-4dc9-a6e1-fcd0b168bbcd None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.658102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12bde-3c6d-4dc9-a6e1-fcd0b168bbcd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.658529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12bde-3c6d-4dc9-a6e1-fcd0b168bbcd None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.660246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 245/486] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:50.661052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12bde-3c6d-4dc9-a6e1-fcd0b168bbcd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:50.670934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707480f-1451-42d7-a41d-6253e2ae6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.671542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707480f-1451-42d7-a41d-6253e2ae6053 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.671817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707480f-1451-42d7-a41d-6253e2ae6053 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.672083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707480f-1451-42d7-a41d-6253e2ae6053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.673004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707480f-1451-42d7-a41d-6253e2ae6053 None admin] RBAC: Adding query filter params (role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=32ee11e2d4324bb7a9b83c8fd2b98bb7) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:50.673313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707480f-1451-42d7-a41d-6253e2ae6053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.674920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707480f-1451-42d7-a41d-6253e2ae6053 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.687296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 242/487] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:50 2022] GET /identity/v3/role_assignments?user.id=32ee11e2d4324bb7a9b83c8fd2b98bb7&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:50.688756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8084b2a-7d94-47b1-bb86-bf720c813177 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.689040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8084b2a-7d94-47b1-bb86-bf720c813177 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.689315 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8084b2a-7d94-47b1-bb86-bf720c813177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.732650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c8084b2a-7d94-47b1-bb86-bf720c813177 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:50.733364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c8084b2a-7d94-47b1-bb86-bf720c813177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:50.774464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:50.833652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 243/488] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:50.871587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12bde-3c6d-4dc9-a6e1-fcd0b168bbcd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:50.904974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:50.921307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6693f14-5205-4bfc-935a-c90d0fc1c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:50.921307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6693f14-5205-4bfc-935a-c90d0fc1c573 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:50.921307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6693f14-5205-4bfc-935a-c90d0fc1c573 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:50.921307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6693f14-5205-4bfc-935a-c90d0fc1c573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:50.922029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6693f14-5205-4bfc-935a-c90d0fc1c573 None admin] RBAC: Adding query filter params (role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=60e4cc87886d4b7788864eaf94334e22) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:50.922029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6693f14-5205-4bfc-935a-c90d0fc1c573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:50.922029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6693f14-5205-4bfc-935a-c90d0fc1c573 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:50.928188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 246/489] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:50 2022] GET /identity/v3/role_assignments?user.id=60e4cc87886d4b7788864eaf94334e22&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:51.128147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15087087-4853-4f29-a66a-0936a01b394d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.128147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15087087-4853-4f29-a66a-0936a01b394d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.128147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15087087-4853-4f29-a66a-0936a01b394d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.128147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 244/490] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:51.142399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb49dca-f7d2-4d01-9509-6dde5c893674 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.142399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb49dca-f7d2-4d01-9509-6dde5c893674 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.142399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb49dca-f7d2-4d01-9509-6dde5c893674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.142795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15087087-4853-4f29-a66a-0936a01b394d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.165459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2bb49dca-f7d2-4d01-9509-6dde5c893674 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:51.167206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2bb49dca-f7d2-4d01-9509-6dde5c893674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:51.266850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 247/491] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:51.323434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15087087-4853-4f29-a66a-0936a01b394d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.361071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.361699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.361974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.362241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.373259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:51.378132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:51.379036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:51.379872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:51.384063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 245/492] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:51.385457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb49dca-f7d2-4d01-9509-6dde5c893674 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.492931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb49dca-f7d2-4d01-9509-6dde5c893674 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.511420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.531587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.532123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.532401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.532699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.533365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:51.533666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:51.535035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:51.548413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 248/493] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:51.550073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.569445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.674826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d89957-2044-48d5-b93e-015e4d130d23 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.715942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.716609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.716887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.717753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.729252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:51.730893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:51.746654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6afea7-0648-48fe-99dc-479d1a4c6c61 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:51.747582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:51.748609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:51.749506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:51.749506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:51.749506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:51.755653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 246/494] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:51.755653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.825225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.826246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.826804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.827292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.831480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.851419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:51.861578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:51.862689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:51.863606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:51.869007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 249/495] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:51.872498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6e2da-401a-4523-b766-a8e17c885ffe None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:51.875758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:51.937575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:51.957689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:51.958309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:51.958638 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:51.958910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:51.959558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:51.959904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:51.961889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.002782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 247/496] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:52.004504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7d90-bf04-4f28-bbd8-861adb85bdb0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.017459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.042983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.043870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.044350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.044824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.045654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:52.046131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.047708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.058224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 250/497] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:52.064319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.186012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.192467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20cdf6-b463-479e-9cf5-3de34d6f88ba None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.217535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ff22a-6af0-45db-9ab4-331481b16d20 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.248804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.252987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.253613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.253883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.254146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.262345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.263789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:52.276312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:52.277339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:52.278494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 248/498] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:52.285929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.286572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.286677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.286933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.287224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.321671 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.323243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:52.346473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:52.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:52.348903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:52.348903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:52.348903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:52.358131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 251/499] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:52.368372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.421221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f538b6-17db-4ef4-b440-442647de45a3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.481121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.482050 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.482493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.482924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.483806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:52.484255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.485858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.513279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 249/500] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:52.518676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.548408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65145bd9-04f8-4444-90c1-1fa19912e17e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.599882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.615872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.630388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.630388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.630388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.630388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:52.630388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.630388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.644090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 252/501] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:52.650058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.680868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.683864 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0df1c-c258-45b4-bb1d-a3d2c1752901 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.734377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.735027 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.735303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.735558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.755337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.756808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:52.784872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:52.785983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:52.786893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:52.786893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:52.786893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:52.791557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 250/502] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:22:52.795676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:52.849867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3b08f-33ea-41be-9abf-154152663e95 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.894037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef7cf8-8d2a-4267-9db4-00c598c5418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.894910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef7cf8-8d2a-4267-9db4-00c598c5418f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.895184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef7cf8-8d2a-4267-9db4-00c598c5418f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.896316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef7cf8-8d2a-4267-9db4-00c598c5418f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.904739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef7cf8-8d2a-4267-9db4-00c598c5418f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.906934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef7cf8-8d2a-4267-9db4-00c598c5418f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-14ef7cf8-8d2a-4267-9db4-00c598c5418f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:52.920500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:52.922704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 253/503] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349e400-312f-4bdb-8883-86c5fae2978a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.925088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349e400-312f-4bdb-8883-86c5fae2978a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.926740 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349e400-312f-4bdb-8883-86c5fae2978a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.927862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:52.928675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 254/504] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:52.932529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529ebe-1578-4470-ab87-4f8f7eeab0f1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:52.933956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1410-789b-4900-9873-64e4d844b132 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.934243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1410-789b-4900-9873-64e4d844b132 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.934521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1410-789b-4900-9873-64e4d844b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.957862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e17e1410-789b-4900-9873-64e4d844b132 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:52.959217 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e17e1410-789b-4900-9873-64e4d844b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:52.971447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:52.972134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:52.972496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:52.972830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:52.973724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:52.974110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:52.975541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:52.991403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 251/505] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:52.992670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.040103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 255/506] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:53.047773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1410-789b-4900-9873-64e4d844b132 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.047773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.156071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75781c63-4558-4618-a3c5-d3f8151059d3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.215365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1410-789b-4900-9873-64e4d844b132 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.227769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.228397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.228693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.228954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.229688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:53.229984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.231421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.255017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 252/507] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Nov 2 07:22:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:53.269039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.277904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.278793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.279217 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.279632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.287881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.290357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:53.303091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:53.304170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:53.305123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:53.307356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 256/508] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:53.307516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.317411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.405258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.424931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba6bd7-178a-4958-8066-b2fadc74215e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.445260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1a5c3-693a-4240-9873-b202590e8dae None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.462141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.462812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.463283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.463753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.481431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f75f7-2a1e-457c-80c0-6494a7c3dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.482259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f75f7-2a1e-457c-80c0-6494a7c3dff2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.482861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f75f7-2a1e-457c-80c0-6494a7c3dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.483140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f75f7-2a1e-457c-80c0-6494a7c3dff2 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.483992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f75f7-2a1e-457c-80c0-6494a7c3dff2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:53.484298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f75f7-2a1e-457c-80c0-6494a7c3dff2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.485760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f75f7-2a1e-457c-80c0-6494a7c3dff2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.498680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 257/509] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:53.500080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc3daa-9b68-4932-a56c-957be9b507da None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.500597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc3daa-9b68-4932-a56c-957be9b507da None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.501070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc3daa-9b68-4932-a56c-957be9b507da None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.506384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 258/510] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:53.506384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc3daa-9b68-4932-a56c-957be9b507da None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.549332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.550783 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.571417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.619704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc3daa-9b68-4932-a56c-957be9b507da None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.643036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.655363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea7f7b-b92b-466c-92df-e32b13ab6624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.656241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7f7b-b92b-466c-92df-e32b13ab6624 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.656546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7f7b-b92b-466c-92df-e32b13ab6624 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.656821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea7f7b-b92b-466c-92df-e32b13ab6624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.661799 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 253/511] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:53.666911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.667138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea7f7b-b92b-466c-92df-e32b13ab6624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.668621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea7f7b-b92b-466c-92df-e32b13ab6624 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-faea7f7b-b92b-466c-92df-e32b13ab6624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:53.684104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:53.685174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:53.686091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:53.686091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:53.686091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:53.686091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 259/512] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:53.686737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dc263-a3d9-4e67-9a36-d854ca1ee023 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.686737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dc263-a3d9-4e67-9a36-d854ca1ee023 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.686978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dc263-a3d9-4e67-9a36-d854ca1ee023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.705817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5d4dc263-a3d9-4e67-9a36-d854ca1ee023 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:53.706981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5d4dc263-a3d9-4e67-9a36-d854ca1ee023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:53.772092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04704-3f88-43cf-ac32-3c3d19eb4be9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.772735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 260/513] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:53.773657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dc263-a3d9-4e67-9a36-d854ca1ee023 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.788730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.806822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.807471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.807745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.808012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/e5e6e7eee9ea4be093bb283594f7651c/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.810006 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=e5e6e7eee9ea4be093bb283594f7651c, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.811442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.879493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dc263-a3d9-4e67-9a36-d854ca1ee023 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:53.881848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:53.912410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa87d9-9ff8-435d-85c0-249d9c3bffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:53.913055 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa87d9-9ff8-435d-85c0-249d9c3bffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.913331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa87d9-9ff8-435d-85c0-249d9c3bffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.913601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa87d9-9ff8-435d-85c0-249d9c3bffc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.923356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa87d9-9ff8-435d-85c0-249d9c3bffc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:53.934852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 254/514] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:22:53 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/e5e6e7eee9ea4be093bb283594f7651c/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:22:53.935016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa87d9-9ff8-435d-85c0-249d9c3bffc7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:53.937409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6daa87d9-9ff8-435d-85c0-249d9c3bffc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:53.941088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:53.942090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:53.943109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:53.943109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:53.943109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:53.943109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 261/515] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:53.944128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807330df-f36b-42dc-b17c-2c0a20ccb79b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:53.944482 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807330df-f36b-42dc-b17c-2c0a20ccb79b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:53.945262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807330df-f36b-42dc-b17c-2c0a20ccb79b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:53.947940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 262/516] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:53.947940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807330df-f36b-42dc-b17c-2c0a20ccb79b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.085065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c354214-68d4-40a9-a395-7581e22a2069 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.086494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807330df-f36b-42dc-b17c-2c0a20ccb79b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.126772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798c227-07d5-47ca-a837-c0f211bbfa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.129033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798c227-07d5-47ca-a837-c0f211bbfa54 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.129033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798c227-07d5-47ca-a837-c0f211bbfa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.129033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798c227-07d5-47ca-a837-c0f211bbfa54 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.129033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798c227-07d5-47ca-a837-c0f211bbfa54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:54.129033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798c227-07d5-47ca-a837-c0f211bbfa54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.130549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798c227-07d5-47ca-a837-c0f211bbfa54 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.132997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.133790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.134205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.134630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.135405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:54.135844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.137363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.142978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 255/517] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:54.144461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6998d4-06eb-482e-89e4-a851f02ccee8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.144875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6998d4-06eb-482e-89e4-a851f02ccee8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.145275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6998d4-06eb-482e-89e4-a851f02ccee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.151028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 263/518] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:54.152105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.167169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7d6998d4-06eb-482e-89e4-a851f02ccee8 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:54.169080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7d6998d4-06eb-482e-89e4-a851f02ccee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:54.177017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:54.202931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:54.248714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 256/519] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:54.249538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6998d4-06eb-482e-89e4-a851f02ccee8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.267890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c6b07-f231-46d5-9924-e71f094cfef5 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.312294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.312973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.313218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.313490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.314509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.316211 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:54.330056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:54.331300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:22:54.332291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:54.336873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 264/520] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:54.337669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.373495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6998d4-06eb-482e-89e4-a851f02ccee8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.418129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.419042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.419658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.420529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.421585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.423165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.441454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:54.461874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103e599-7439-42a4-b341-11e11e105721 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.498640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.499265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.499612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.499875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.507410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.508656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 257/521] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:22:54 2022] POST /identity/v3/users => generated 254 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:54.509777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.512133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:54.533880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:54.534883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 265/522] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:54.535800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.547717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:54.659726 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7614f9-4be1-45fa-84de-146cc2f0ca6a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.696196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32771-2c84-40ef-aa1d-e9c6d220791b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.714241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.714861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.715139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.715408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.716043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:54.716346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.717738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.722738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 258/523] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:54.723354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.742338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.742968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.743241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.743557 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] PATH_INFO: `/v3/services/network` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.744137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.745536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:54.754793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:54.755835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:54.756738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 266/524] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:54.757592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.761547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:54.861662 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d5ea9-104b-4274-9349-6abe56516b0c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.863989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:54.870810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8234d-e0be-438b-b804-f2d5f3f0a363 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:54.907920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.908788 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:54.909456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.910423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:54.910587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.910986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.911810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:54.912115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:54.912490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:54.912925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.913813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:54.914193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:54.915580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.915768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:54.928475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 267/525] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:54.928475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:54.943507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 259/526] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:54.952317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.072479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:55.136629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1b6f-c70e-4e43-8b30-1c1cf7468594 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.149167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376beba3-431b-4245-bfab-686882dcf483 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.178931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.179733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.180100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.180493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.181403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] RBAC: Adding query filter params (name=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:55.181801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:55.183932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:55.192305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 268/527] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:55.197354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:55.201843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7695dc-42fa-4024-aab7-12ef9cf957c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.202661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7695dc-42fa-4024-aab7-12ef9cf957c1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.203085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7695dc-42fa-4024-aab7-12ef9cf957c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.203500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7695dc-42fa-4024-aab7-12ef9cf957c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.204370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7695dc-42fa-4024-aab7-12ef9cf957c1 None admin] RBAC: Adding query filter params (role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=7037b6179bdd434db3780d97d20060bd) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:55.204855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7695dc-42fa-4024-aab7-12ef9cf957c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:55.207606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7695dc-42fa-4024-aab7-12ef9cf957c1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:55.216300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 260/528] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:22:54 2022] GET /identity/v3/role_assignments?user.id=7037b6179bdd434db3780d97d20060bd&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:55.317202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00c7b6-b98a-4ecf-86c2-2b29b1533c5a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:55.365105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:55.370985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156fa6f-9627-4ce3-b3d7-348fec322c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:55.378863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156fa6f-9627-4ce3-b3d7-348fec322c37 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:55.378863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156fa6f-9627-4ce3-b3d7-348fec322c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:55.378863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156fa6f-9627-4ce3-b3d7-348fec322c37 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:55.378863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156fa6f-9627-4ce3-b3d7-348fec322c37 None admin] RBAC: Adding query filter params (type=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:55.378863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156fa6f-9627-4ce3-b3d7-348fec322c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:55.378863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156fa6f-9627-4ce3-b3d7-348fec322c37 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:55.383376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 269/529] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:22:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:56.204195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ea025-8f23-4f9b-ab73-e073b226ab95 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.204727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ea025-8f23-4f9b-ab73-e073b226ab95 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.204845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ea025-8f23-4f9b-ab73-e073b226ab95 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.206383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 261/530] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:56.211305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27859e-cd26-4f27-a39c-d87c17f0f5ce None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.211594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27859e-cd26-4f27-a39c-d87c17f0f5ce None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.211863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27859e-cd26-4f27-a39c-d87c17f0f5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.237363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bd27859e-cd26-4f27-a39c-d87c17f0f5ce None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:56.238543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bd27859e-cd26-4f27-a39c-d87c17f0f5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:56.325617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 270/531] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:56.754380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ea025-8f23-4f9b-ab73-e073b226ab95 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.771485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:56.885105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ea025-8f23-4f9b-ab73-e073b226ab95 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:56.927745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1bca-f208-4a35-a3d9-65d31be8989a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.928073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1bca-f208-4a35-a3d9-65d31be8989a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.928291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1bca-f208-4a35-a3d9-65d31be8989a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.929709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 271/532] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:22:56.931784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:56.932401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.932700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.932966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.936263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df8b0-55c5-4b33-8528-5a856b673794 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:56.936571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df8b0-55c5-4b33-8528-5a856b673794 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:56.936842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2df8b0-55c5-4b33-8528-5a856b673794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:56.943694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:56.949037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:56.950011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:56.950865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 262/533] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:56.968930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4b2df8b0-55c5-4b33-8528-5a856b673794 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:56.969250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:56.970165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b2df8b0-55c5-4b33-8528-5a856b673794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:57.090884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 272/534] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 07:22:57.092654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.123718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa613a7-7189-4745-861a-9de52d5d8a25 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.174183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.174785 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.175063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.175329 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.175990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.176289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.177674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.191325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 263/535] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:22:57.197465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df8b0-55c5-4b33-8528-5a856b673794 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.255350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.311226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2df8b0-55c5-4b33-8528-5a856b673794 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.346635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.347250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.347465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.347704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.358186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.359694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:57.378787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.379767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:57.381300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:57.381300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:57.381300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:57.381300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 273/536] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.386350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.448203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.559181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a768fa-91d6-4af2-83d5-f53a3b971844 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.621123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.629426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.630043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.630319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.630583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.631222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.631522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.633516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.640118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db725d-7617-4e61-8025-1941785fc56e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.657158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.659726 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 264/537] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.665930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.699794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f09c1-486b-4bb1-94be-6306abd3dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.700444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f09c1-486b-4bb1-94be-6306abd3dad0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.700846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f09c1-486b-4bb1-94be-6306abd3dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.701121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f09c1-486b-4bb1-94be-6306abd3dad0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.712613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f09c1-486b-4bb1-94be-6306abd3dad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-fb6f09c1-486b-4bb1-94be-6306abd3dad0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:57.717661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.718687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:57.719542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 274/538] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.720407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a542-fb6b-48e0-8896-f7c687ccf645 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.720641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a542-fb6b-48e0-8896-f7c687ccf645 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.720915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223a542-fb6b-48e0-8896-f7c687ccf645 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.726840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 275/539] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:57.726840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a542-fb6b-48e0-8896-f7c687ccf645 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.799268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25eb59-c55a-4924-8369-9e492aa2e829 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.837497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223a542-fb6b-48e0-8896-f7c687ccf645 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:57.846127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da767ac8-1697-4137-893d-3b8cc31e6819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.846760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767ac8-1697-4137-893d-3b8cc31e6819 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.847500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767ac8-1697-4137-893d-3b8cc31e6819 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.847782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da767ac8-1697-4137-893d-3b8cc31e6819 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.858258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da767ac8-1697-4137-893d-3b8cc31e6819 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.860601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da767ac8-1697-4137-893d-3b8cc31e6819 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-da767ac8-1697-4137-893d-3b8cc31e6819 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:57.874028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:57.874976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:57.875930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 265/540] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:57.877024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6c1eb-3861-4b9f-858b-d39bc83d32fc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.877024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6c1eb-3861-4b9f-858b-d39bc83d32fc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.877176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6c1eb-3861-4b9f-858b-d39bc83d32fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.885884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:57.886804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:57.887281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:57.887747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:57.888642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:57.889171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:57.890738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:57.898511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-16e6c1eb-3861-4b9f-858b-d39bc83d32fc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:57.899777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-16e6c1eb-3861-4b9f-858b-d39bc83d32fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:57.900969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 276/541] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:57.902208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:57.937680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.960831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:57.988525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 266/542] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:57.989750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6c1eb-3861-4b9f-858b-d39bc83d32fc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.048021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17498405-e637-4d96-aa9b-86ce13c44020 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.088936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e625f-9186-4ace-b58b-7ca8ed43ff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.089540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e625f-9186-4ace-b58b-7ca8ed43ff96 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.089844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e625f-9186-4ace-b58b-7ca8ed43ff96 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.090194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e625f-9186-4ace-b58b-7ca8ed43ff96 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.091020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e625f-9186-4ace-b58b-7ca8ed43ff96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.091322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e625f-9186-4ace-b58b-7ca8ed43ff96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.092837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e625f-9186-4ace-b58b-7ca8ed43ff96 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.112132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 277/543] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.113571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866c20-e5fa-411f-a8f7-ddcf0087ed1c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.113851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866c20-e5fa-411f-a8f7-ddcf0087ed1c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.114222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866c20-e5fa-411f-a8f7-ddcf0087ed1c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.119246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 278/544] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:58.130148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c513c-1f5c-4b5a-862a-3085a7defbba None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.130148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c513c-1f5c-4b5a-862a-3085a7defbba None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.130148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c513c-1f5c-4b5a-862a-3085a7defbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.151420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6c1eb-3861-4b9f-858b-d39bc83d32fc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.157764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9f6c513c-1f5c-4b5a-862a-3085a7defbba None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:58.159066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9f6c513c-1f5c-4b5a-862a-3085a7defbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:58.195981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.196957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.197337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.197705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.210298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.211995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:58.229888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:58.231088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:58.231992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:58.231992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:58.231992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:58.231992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 267/545] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:58.233127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.244631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 279/546] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:58.245755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c513c-1f5c-4b5a-862a-3085a7defbba None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.270748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.302447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.370214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021be70f-6bae-41b8-a4df-34241ac54421 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.375510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c513c-1f5c-4b5a-862a-3085a7defbba None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.408281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081508-c6fd-4e70-aa3a-0f845ec3c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.410231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081508-c6fd-4e70-aa3a-0f845ec3c95f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.410712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081508-c6fd-4e70-aa3a-0f845ec3c95f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.411197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081508-c6fd-4e70-aa3a-0f845ec3c95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.413808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.414403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.414683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.414949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.415579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:58.415913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.417263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.429285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 280/547] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:58.430064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.495228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081508-c6fd-4e70-aa3a-0f845ec3c95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.496726 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081508-c6fd-4e70-aa3a-0f845ec3c95f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.508931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.529903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce212d43-200b-413a-8db2-85fb9551547e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.531833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.565726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.566397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.566669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.566939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.567579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.568960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.598084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 268/548] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 07:22:58.599325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c97d5-9448-420d-9d68-068e74754d93 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.599605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c97d5-9448-420d-9d68-068e74754d93 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.599875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c97d5-9448-420d-9d68-068e74754d93 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.601880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 269/549] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:22:58.602388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c97d5-9448-420d-9d68-068e74754d93 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.664976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 281/550] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:22:58 2022] POST /identity/v3/services => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:58.665727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.725217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c97d5-9448-420d-9d68-068e74754d93 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.762483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.769580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.770306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.770509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.770782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.779962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.781722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.782352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b39b20-6304-44f8-92c8-1ce24b954cec None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:22:58.795233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:58.796296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 270/551] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:58.797284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.826453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a843de-fbd0-480e-8916-d10d0de34d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.827086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a843de-fbd0-480e-8916-d10d0de34d76 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.827365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a843de-fbd0-480e-8916-d10d0de34d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.827633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a843de-fbd0-480e-8916-d10d0de34d76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.835499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:58.840682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a843de-fbd0-480e-8916-d10d0de34d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-65a843de-fbd0-480e-8916-d10d0de34d76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:22:58.845678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:58.851894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 282/552] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:58.852822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87ffe-0e62-4427-b7b7-95a03451c681 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.853604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87ffe-0e62-4427-b7b7-95a03451c681 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.853604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de87ffe-0e62-4427-b7b7-95a03451c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.871956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1de87ffe-0e62-4427-b7b7-95a03451c681 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:22:58.873345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1de87ffe-0e62-4427-b7b7-95a03451c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:22:58.908595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d95a5-4a38-4277-8d55-704f89cd4fe8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:58.942762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:58.943316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:58.943590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:58.943863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:58.945945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 283/553] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:22:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 07:22:58.947069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87ffe-0e62-4427-b7b7-95a03451c681 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:58.964414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:58.966037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:58.981750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:58.982763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:58.983699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:58.983699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:58.983699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:58.983699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 271/554] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:58.983699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.030066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.088588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b862833-4abc-4cc5-98e8-7a86985153f7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.104663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de87ffe-0e62-4427-b7b7-95a03451c681 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.132252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.132898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.133176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.133446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.134166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.134475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.135844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.139169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.144909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 272/555] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.152454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.155373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.156248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.156556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.156823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.161135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.161135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.161135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.177498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 284/556] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Nov 2 07:22:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.180176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.291675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c8f38-36cc-451e-a739-7cb6c852dbbe None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.303967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f321-cbdd-43e3-90b3-b9de22a88550 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.307323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.327218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.327834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.328165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.328456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.339216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.340950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.341797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.342857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.343825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.344095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.344771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.345074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.346416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:59.355495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:59.356505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:59.357424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:59.357424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:59.357424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:59.357424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 285/557] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:59.357424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.364405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 273/558] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.365503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.400743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.464022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374328-1f94-44cc-9977-5cce6c76b246 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.480819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc96d20-34fa-44f3-ae09-db6d35f03665 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.498333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.498957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.499233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.499499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.510465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.511892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.516955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.517556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.517829 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.518094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.518745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.520268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:22:59.527133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:59.528845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:22:59.530233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:22:59.530233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:22:59.530233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:22:59.530233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 286/559] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:59.530233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.608220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 274/560] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:22:59 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:22:59.609535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.630815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.648638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802fc9-9bb5-406d-aac8-6a63dd8daa3f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.650027 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.701717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.702760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.703240 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.703711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.704651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.705163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.706983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.721054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 287/561] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.722274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.748987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5210f6-f867-47a4-9e5f-8246f59e7212 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.788624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.789286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.789568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.797782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.799284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:22:59.812295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:22:59.813400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:22:59.814309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 275/562] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:22:59.814792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.843178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6105bc-fac2-4d0e-84dd-94c4a7830b0b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.893067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.893716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.894062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.894402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.895112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:22:59.895481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.897053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:22:59.910270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 288/563] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:22:59.911364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:22:59.924548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.926391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:22:59.948348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c44ff-9ce9-40ab-b903-5f7c74935ee4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:22:59.983390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:22:59.984052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:22:59.984350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:22:59.984891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:22:59.995458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:22:59.997033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:00.010179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:00.011388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 276/564] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:00.012573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.052477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331d69a-8ac7-4f81-9ee1-698431016cb5 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.087615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1185862-1002-4308-b3af-148214d094fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.088498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1185862-1002-4308-b3af-148214d094fc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.088618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1185862-1002-4308-b3af-148214d094fc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.088803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1185862-1002-4308-b3af-148214d094fc None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.089491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1185862-1002-4308-b3af-148214d094fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:00.089783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1185862-1002-4308-b3af-148214d094fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.091246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1185862-1002-4308-b3af-148214d094fc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.109567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 289/565] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:00.109567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1185862-1002-4308-b3af-148214d094fc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.148617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b498dd-0666-45a0-a5d1-95080434bd67 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.187554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.188297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.188681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.188950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.196261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.197850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.200948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:00.210492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:00.217997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 277/566] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:00.219129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.219980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:00.255561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1185862-1002-4308-b3af-148214d094fc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.293967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.294891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.295315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.295829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.296791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:00.297270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.298889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.318725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 290/567] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Nov 2 07:23:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:00.320000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.348258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13116c-4cda-4257-b0af-1727ac686abc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.391791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.392833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.393214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.393551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.394412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=e5e6e7eee9ea4be093bb283594f7651c) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:00.394994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.398005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.406101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 278/568] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:00 2022] GET /identity/v3/role_assignments?user.id=e5e6e7eee9ea4be093bb283594f7651c&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:00.407560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.486746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a439-c7cc-40e6-bf86-e12b5ceaa5c4 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.491478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:00.533542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5e22f-ff6e-4066-9f60-d68e24a2523e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.558193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:00.579470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.580563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.581040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.581501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.597078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.598881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.605176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.605805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.606087 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.606359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.607061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:00.607366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.608836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:00.617875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:00.618959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:00.619881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:00.619881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:00.619881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:00.622096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 279/569] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:00.627819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.635998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 291/570] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:00.641574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.756285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d936d7c-ce24-4760-b0e1-28e56d6ed975 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.785570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:00.786532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a4b73-8630-4050-8278-f159e4657247 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.804873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.806061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.806901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.807396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.808230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:00.808749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.811119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.827323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e562e7-5520-45f1-95c3-361467888be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.827983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e562e7-5520-45f1-95c3-361467888be7 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.828260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e562e7-5520-45f1-95c3-361467888be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.828700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e562e7-5520-45f1-95c3-361467888be7 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/fdcfc478d70e4bc388cfd0dff157a817/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:00.829106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 280/571] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:00.834000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:00.845649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e562e7-5520-45f1-95c3-361467888be7 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=fdcfc478d70e4bc388cfd0dff157a817, role_id=fd0ef19bc1bb4e4fa93c50d4be28ba9a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:00.847139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e562e7-5520-45f1-95c3-361467888be7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:00.938217 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 292/572] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:00 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/fdcfc478d70e4bc388cfd0dff157a817/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:23:00.951269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd46da-ff6b-4a11-818d-6cef0de1652d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:00.990609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c428c-3176-4229-afa7-a760f7e28479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:00.992261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c428c-3176-4229-afa7-a760f7e28479 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:00.992772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c428c-3176-4229-afa7-a760f7e28479 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:00.993233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c428c-3176-4229-afa7-a760f7e28479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.001360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c428c-3176-4229-afa7-a760f7e28479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:01.003268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c428c-3176-4229-afa7-a760f7e28479 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:01.016053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f104d2f-3bb7-4537-bf8d-dc032bc6b681 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-307c428c-3176-4229-afa7-a760f7e28479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:01.016217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:01.017092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:01.018031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:01.018486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f104d2f-3bb7-4537-bf8d-dc032bc6b681 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.018486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f104d2f-3bb7-4537-bf8d-dc032bc6b681 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.020415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 293/573] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:01.020920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 281/574] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:01.028477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f104d2f-3bb7-4537-bf8d-dc032bc6b681 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:01.031739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f424-28f8-4261-9ade-32736bf33acc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.032030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f424-28f8-4261-9ade-32736bf33acc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.032283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684f424-28f8-4261-9ade-32736bf33acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.058479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d684f424-28f8-4261-9ade-32736bf33acc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:01.059682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d684f424-28f8-4261-9ade-32736bf33acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:01.096168 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:01.107878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:01.187426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 282/575] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:01.198699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f104d2f-3bb7-4537-bf8d-dc032bc6b681 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:01.235495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:01.236090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.236361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.236710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.237390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:01.237685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:01.239107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:01.251100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 294/576] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:01.256756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684f424-28f8-4261-9ade-32736bf33acc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:01.361603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684f424-28f8-4261-9ade-32736bf33acc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:01.396568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:01.397812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.398175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.398446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/7037b6179bdd434db3780d97d20060bd/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.400332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=7037b6179bdd434db3780d97d20060bd, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:01.401787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:01.491608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:01.515132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 283/577] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:01 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/7037b6179bdd434db3780d97d20060bd/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:23:01.613419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:01.624620 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e52ba-f391-47ce-a16b-79bd3ea9aeff None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:01.662162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:01.663348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.663622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.663891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.664502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:01.665892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:01.675548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:01.676601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:01.677515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 295/578] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Nov 2 07:23:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:01.683582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:01.717257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:01.830964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144b1d4-f3f5-4549-9e8b-cf6f0d6b6d62 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:01.886908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:01.887753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:01.888211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:01.888694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:01.889786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:01.890293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:01.892701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:01.901484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 284/579] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:01.910706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.104950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246caf5b-0d6b-441f-8a39-6bb5ad6945bc None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.166370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687e29e-1b36-4bb7-a136-c1d6a20aa6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.167656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687e29e-1b36-4bb7-a136-c1d6a20aa6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.168327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687e29e-1b36-4bb7-a136-c1d6a20aa6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.168990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687e29e-1b36-4bb7-a136-c1d6a20aa6d4 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.170329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687e29e-1b36-4bb7-a136-c1d6a20aa6d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:02.174434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687e29e-1b36-4bb7-a136-c1d6a20aa6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.174434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687e29e-1b36-4bb7-a136-c1d6a20aa6d4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.182373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 296/580] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:02.191245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.199890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1b680-0454-4f0e-be94-37d81146dc9d None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.200353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1b680-0454-4f0e-be94-37d81146dc9d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.200835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1b680-0454-4f0e-be94-37d81146dc9d None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.203416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 297/581] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:02.220651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d252-634e-4ad4-9137-5a9b64120f7a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.221100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d252-634e-4ad4-9137-5a9b64120f7a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.221550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54d252-634e-4ad4-9137-5a9b64120f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.250351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8c54d252-634e-4ad4-9137-5a9b64120f7a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:02.252254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8c54d252-634e-4ad4-9137-5a9b64120f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:02.308925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.394750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:02.396479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 298/582] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:02.403699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338fd4c-8ddb-402c-9955-e09528c9eaa6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.446734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.449881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.450310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.450753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.451606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] RBAC: Adding query filter params (interface=public, service_id=7a24f0c100094fff8a601ec5557148e3, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:02.452076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.453647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.464837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 285/583] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/endpoints?service_id=7a24f0c100094fff8a601ec5557148e3&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:02.470470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54d252-634e-4ad4-9137-5a9b64120f7a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.575893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54d252-634e-4ad4-9137-5a9b64120f7a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.615347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.616749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.617172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.617586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.618399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.619978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.625882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 299/584] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:02.675100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.817064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c41c-56b2-470e-860b-c17d4a595ff1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:02.865606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:02.866789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:02.867062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:02.867321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] PATH_INFO: `/v3/services/network` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:02.867910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:02.870699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:02.884166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:02.885405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:02.886885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 286/585] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:02.891213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:02.912476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.003751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a542-26fd-4c6e-bc32-f4b6b593d2ef None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.043239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.043853 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.044300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.044598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.045233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] RBAC: Adding query filter params (name=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:03.045528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.046885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.052633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 300/586] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.061010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.088843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.169464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6141-ebac-42cd-9b16-6ad44620ab54 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.204378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc291b2a-1d7c-42d8-8856-c85ff8af320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.205009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291b2a-1d7c-42d8-8856-c85ff8af320a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.205279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291b2a-1d7c-42d8-8856-c85ff8af320a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.205545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc291b2a-1d7c-42d8-8856-c85ff8af320a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.206169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291b2a-1d7c-42d8-8856-c85ff8af320a None admin] RBAC: Adding query filter params (type=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:03.206465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291b2a-1d7c-42d8-8856-c85ff8af320a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.207833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc291b2a-1d7c-42d8-8856-c85ff8af320a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.214405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 287/587] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.221525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.324466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.351156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fc970-7ea8-415f-a9fd-0775f46c4448 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.381637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6fc9-8791-4b34-9b37-89d3dc4828f0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.381963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6fc9-8791-4b34-9b37-89d3dc4828f0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.382174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed6fc9-8791-4b34-9b37-89d3dc4828f0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.383804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 288/588] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:03.389133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d76e2c-1f12-4181-bdf3-2e125acfa2ce None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.389667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d76e2c-1f12-4181-bdf3-2e125acfa2ce None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.389941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d76e2c-1f12-4181-bdf3-2e125acfa2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.394116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.394976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.395461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.395951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.396889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] RBAC: Adding query filter params (interface=public, service_id=610f258d0b514353af10a41a597ff3ed, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:03.397963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.399487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.408201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 301/589] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/endpoints?service_id=610f258d0b514353af10a41a597ff3ed&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.414165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.432463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-57d76e2c-1f12-4181-bdf3-2e125acfa2ce None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:03.432463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-57d76e2c-1f12-4181-bdf3-2e125acfa2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:03.555363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 289/590] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:03.576585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ef12-0476-423d-9474-cb28f0faaf1d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:03.612247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495cf1e-1937-4cb0-90b3-824b24084cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:03.612832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cf1e-1937-4cb0-90b3-824b24084cdc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.613109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cf1e-1937-4cb0-90b3-824b24084cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.613382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495cf1e-1937-4cb0-90b3-824b24084cdc None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.613981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495cf1e-1937-4cb0-90b3-824b24084cdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:03.615338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495cf1e-1937-4cb0-90b3-824b24084cdc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:03.621069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 302/591] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:03.926333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a283c2-9b0a-4aca-b9e4-14d4d268cdd0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.927139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a283c2-9b0a-4aca-b9e4-14d4d268cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.927554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a283c2-9b0a-4aca-b9e4-14d4d268cdd0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.929955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 290/592] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:03.935524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772a12-5bcd-4811-a281-26ce1a5fbe70 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:03.936037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772a12-5bcd-4811-a281-26ce1a5fbe70 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:03.936547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772a12-5bcd-4811-a281-26ce1a5fbe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:03.949765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a283c2-9b0a-4aca-b9e4-14d4d268cdd0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:03.958640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-99772a12-5bcd-4811-a281-26ce1a5fbe70 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:03.959837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-99772a12-5bcd-4811-a281-26ce1a5fbe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:03.962127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:03.969395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.040560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 303/593] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:04.060942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a283c2-9b0a-4aca-b9e4-14d4d268cdd0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.097567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.098261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.098539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.098806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.099393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.101856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:04.113574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:04.114728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:04.115920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:04.126541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 291/594] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Nov 2 07:23:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:04.132700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772a12-5bcd-4811-a281-26ce1a5fbe70 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.264658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772a12-5bcd-4811-a281-26ce1a5fbe70 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.313182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.313790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.314065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.314331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.314954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:04.315248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.316633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.324396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 304/595] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:04.330068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.433172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.440454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.442547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.468274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b78e12-5d93-4124-8cf9-8285f4faaf6c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.507612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c82924-d9a4-4f62-9d57-71ef2c6488d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.508223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c82924-d9a4-4f62-9d57-71ef2c6488d3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.508530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c82924-d9a4-4f62-9d57-71ef2c6488d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.508801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c82924-d9a4-4f62-9d57-71ef2c6488d3 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.509420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c82924-d9a4-4f62-9d57-71ef2c6488d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:04.509721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c82924-d9a4-4f62-9d57-71ef2c6488d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.511080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c82924-d9a4-4f62-9d57-71ef2c6488d3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.515987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 292/596] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:04.523767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd610757-9d88-4ce4-92a0-aee08de03e2c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.523767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd610757-9d88-4ce4-92a0-aee08de03e2c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.523767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd610757-9d88-4ce4-92a0-aee08de03e2c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.523767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 293/597] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:04.526101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a6b9-bc21-4d5e-9b6b-fdfef450cdc4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.526389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a6b9-bc21-4d5e-9b6b-fdfef450cdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.526659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7a6b9-bc21-4d5e-9b6b-fdfef450cdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.564197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ceb7a6b9-bc21-4d5e-9b6b-fdfef450cdc4 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:04.565437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ceb7a6b9-bc21-4d5e-9b6b-fdfef450cdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:04.646477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5fbe9-9f2e-4f5b-aa76-90f53070f5c5 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.668616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 294/598] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:04.700107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.700806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.701082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.701348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.721839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:04.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:04.728122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:23:04.729077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:04.729735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 305/599] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:04.734501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a6b9-bc21-4d5e-9b6b-fdfef450cdc4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.813891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.839387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7a6b9-bc21-4d5e-9b6b-fdfef450cdc4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:04.879906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:04.880550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:04.880826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:04.881095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:04.882318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:04.882615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:04.883994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:04.892443 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 295/600] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:04.898244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:04.986681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:04.990477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.061551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6528cff-2aa9-4f49-b9ad-62d5b6dd787e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.149727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.150370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.150648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.150919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.158157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b3c8d-c05b-4553-9a02-0b0e717f4ced None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.189283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.190763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.204592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.205226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.205499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.205762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:05.206762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.207675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:05.208618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:05.208618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:05.208618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:05.211691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.212555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 306/601] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:05.217666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.229612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:05.237095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.238943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:05.241014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:05.242514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 296/602] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:05.246599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.347544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db486b1e-94e1-4030-b796-5fbdbc65cdf3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.363913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.388635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.389170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.389449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.389721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.390696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.391005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.392743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.413809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 307/603] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.419398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.476334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f81a55-b0d4-4d80-b269-8ca464c97957 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.549511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.550123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.550400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.550667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.551334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.551634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.553034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.576455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 297/604] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.582481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.613722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9cbc9-461a-4fba-8be4-0b87a350500d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.652391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fce77-c3e5-4581-8a5e-15c900fa76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.653723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fce77-c3e5-4581-8a5e-15c900fa76ed None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.654148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fce77-c3e5-4581-8a5e-15c900fa76ed None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.654564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fce77-c3e5-4581-8a5e-15c900fa76ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.662444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fce77-c3e5-4581-8a5e-15c900fa76ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.664096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fce77-c3e5-4581-8a5e-15c900fa76ed None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.667610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ce4fce77-c3e5-4581-8a5e-15c900fa76ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:05.676214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.677400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:05.679088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:05.681269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 308/605] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:05.682857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9fed7-0e74-4d27-90dc-ceaa83e4ad16 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.683331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9fed7-0e74-4d27-90dc-ceaa83e4ad16 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.683764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9fed7-0e74-4d27-90dc-ceaa83e4ad16 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.689273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 309/606] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:05.693690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9fed7-0e74-4d27-90dc-ceaa83e4ad16 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.715581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3062a-bb50-4f69-b6c8-5d8d926101b4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.732849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:05.757047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba298d-2792-412e-b7f9-a5e3f510f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.757592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba298d-2792-412e-b7f9-a5e3f510f02b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.757871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba298d-2792-412e-b7f9-a5e3f510f02b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.758140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba298d-2792-412e-b7f9-a5e3f510f02b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.770185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba298d-2792-412e-b7f9-a5e3f510f02b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.771643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba298d-2792-412e-b7f9-a5e3f510f02b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c4ba298d-2792-412e-b7f9-a5e3f510f02b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:05.789835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:05.790841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:05.791744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:05.791744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:05.791744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:05.795625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 298/607] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:05.797565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630d89-024a-4345-8b01-cb8fd774048e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.797854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630d89-024a-4345-8b01-cb8fd774048e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.798123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630d89-024a-4345-8b01-cb8fd774048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.809282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9fed7-0e74-4d27-90dc-ceaa83e4ad16 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:05.818413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6d630d89-024a-4345-8b01-cb8fd774048e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:05.820483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6d630d89-024a-4345-8b01-cb8fd774048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:05.850454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:05.851825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:05.852483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:05.853048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:05.854109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:05.854585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:05.856702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:05.879073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 310/608] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:05.880536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.908549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 299/609] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:05.908549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630d89-024a-4345-8b01-cb8fd774048e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:05.985639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.040755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.058035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b2b4-2b85-4ddc-a604-dfe9c9c54b72 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.106241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630d89-024a-4345-8b01-cb8fd774048e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.132454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.132454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.132454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.132454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.132831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:06.132831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.132831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.145364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 311/610] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:06.150978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.205871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce50990-fd04-4107-9c01-4f1715adcd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.206411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50990-fd04-4107-9c01-4f1715adcd4a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.206670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50990-fd04-4107-9c01-4f1715adcd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.206934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50990-fd04-4107-9c01-4f1715adcd4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.266144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e5a4a-9a91-4c70-8757-864fc2802746 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.296068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50990-fd04-4107-9c01-4f1715adcd4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.298562 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50990-fd04-4107-9c01-4f1715adcd4a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.304399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.305051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.305324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.305590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.313927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.315365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:06.327408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:06.328408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:06.329422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 312/611] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:06.330061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.347746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.352179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.421094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 300/612] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:06.421094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806ade-fda6-4727-b1bc-7c80595ee180 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.421094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806ade-fda6-4727-b1bc-7c80595ee180 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.421094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be806ade-fda6-4727-b1bc-7c80595ee180 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.421094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 301/613] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:06.421094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806ade-fda6-4727-b1bc-7c80595ee180 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.441250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f831513-15dd-40e5-bbd2-0238a8648874 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.478072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.478625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.478906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.479185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.479759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.481159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:06.490038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:06.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:06.491985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 313/614] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:06.492855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.538398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be806ade-fda6-4727-b1bc-7c80595ee180 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.574469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd0476-7d4b-4bfe-9d70-b506379b9db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.575075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd0476-7d4b-4bfe-9d70-b506379b9db9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.575344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd0476-7d4b-4bfe-9d70-b506379b9db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.575605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd0476-7d4b-4bfe-9d70-b506379b9db9 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.576321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd0476-7d4b-4bfe-9d70-b506379b9db9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:06.576657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd0476-7d4b-4bfe-9d70-b506379b9db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.578088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd0476-7d4b-4bfe-9d70-b506379b9db9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.579917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.588956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.603062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 302/615] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:06.603062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a148-1705-4739-afd7-1af86a3aef6a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.603062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a148-1705-4739-afd7-1af86a3aef6a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.603062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a148-1705-4739-afd7-1af86a3aef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.608760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240d826-6a32-4a96-add5-0bf50f574d55 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.617846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6862a148-1705-4739-afd7-1af86a3aef6a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:06.619015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6862a148-1705-4739-afd7-1af86a3aef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:06.645975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.647396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.647686 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.647940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.661219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.663643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:06.683158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:06.684124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:06.685080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:06.685080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:06.685080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:06.685080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 314/616] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:06.685305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.694293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 303/617] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:06.695970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a148-1705-4739-afd7-1af86a3aef6a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.810491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a148-1705-4739-afd7-1af86a3aef6a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.810702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc149c-7c87-4083-bca9-52715355d789 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:06.841683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.844034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:06.849542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f49a0-b584-4632-89b3-f23b6e7dc183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.850175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f49a0-b584-4632-89b3-f23b6e7dc183 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.850448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f49a0-b584-4632-89b3-f23b6e7dc183 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.850710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f49a0-b584-4632-89b3-f23b6e7dc183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.853741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:06.866885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:06.866885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:06.866885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:06.866885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:06.866885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.866885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.867313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 315/618] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:06.867313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:06.921432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f49a0-b584-4632-89b3-f23b6e7dc183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:06.922880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f49a0-b584-4632-89b3-f23b6e7dc183 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:06.972193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5bba5-cade-4eef-9138-7eeb7eac313d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.004545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.005139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.005410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.005673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.006832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.007122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.008486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.019852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 316/619] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.020651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.027748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 304/620] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:07.027748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367b11c-ec2a-4aa6-b7f4-013e907f88e2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.027748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367b11c-ec2a-4aa6-b7f4-013e907f88e2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.027748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367b11c-ec2a-4aa6-b7f4-013e907f88e2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.030834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 305/621] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:07.031629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367b11c-ec2a-4aa6-b7f4-013e907f88e2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.059579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.074196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.116319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907bfe5-fcfa-4a30-a168-356bfddbcc54 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.132774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367b11c-ec2a-4aa6-b7f4-013e907f88e2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.153062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.153656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.153934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.154231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.154853 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.155147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.156786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.161414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 317/622] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.166016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.171392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.172016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.172292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.172593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] PATH_INFO: `/v3/services/network` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.173177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.174557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:07.184454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:07.185640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:07.186669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 306/623] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:07.187661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.264382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a8ecd-c021-41ef-9c4b-373a64eb4d11 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.277427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.280200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.286485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d970e-bde8-4212-a0c6-8ee634ce1a80 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.297333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7b39b-4f14-46cc-99ad-14c706c3f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.297944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7b39b-4f14-46cc-99ad-14c706c3f85a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.298214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7b39b-4f14-46cc-99ad-14c706c3f85a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.298475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7b39b-4f14-46cc-99ad-14c706c3f85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.308607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7b39b-4f14-46cc-99ad-14c706c3f85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.309966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7b39b-4f14-46cc-99ad-14c706c3f85a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.320693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.321305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.321581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.324362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-f8a7b39b-4f14-46cc-99ad-14c706c3f85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:07.324518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:07.325571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:07.326486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:07.326486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:07.326486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:07.326486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 318/624] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:07.326486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c87d46-c5bc-4bb7-84b1-6681b0911230 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.326791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c87d46-c5bc-4bb7-84b1-6681b0911230 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.326932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c87d46-c5bc-4bb7-84b1-6681b0911230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.331190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.332745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:07.344597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:07.345524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:07.346442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:07.347292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b0c87d46-c5bc-4bb7-84b1-6681b0911230 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:07.347385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 307/625] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:07.347385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.347555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0c87d46-c5bc-4bb7-84b1-6681b0911230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:07.411655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 319/626] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:07.412296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c87d46-c5bc-4bb7-84b1-6681b0911230 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.452653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebfb56-f389-4450-bf07-fdc91963a4ad None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.486870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.487469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.487744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.488008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.488689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.490036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.508084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.512134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c87d46-c5bc-4bb7-84b1-6681b0911230 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.545401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.546019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.546294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.546564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.547179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] RBAC: Adding query filter params (name=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.547477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.548912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.553877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 320/627] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.554382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.639106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 308/628] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:07.639106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.642003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.670134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16388-970f-4a32-a119-0f0505484c29 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.719382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.720040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.720310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.720602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.721236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.721530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.722932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.735678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 321/629] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.736680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.745398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b712060-e762-4b44-bd41-f5027ceffd30 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.757512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.786235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.786861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.787147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.787983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.788753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.789059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.790507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.803948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 309/630] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.804863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.853134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f8d1-bfdf-4c6b-b05a-d8f678925f8c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.881384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:07.894247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.895068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.895628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.896470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.898082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] RBAC: Adding query filter params (type=network) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:07.898526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.900514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:07.907535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 322/631] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:07.908993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:07.915555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd626-07a2-4601-9294-9d867c1ca844 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:07.950961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:07.951566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:07.951869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:07.952136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:07.952810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:07.954173 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.002148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:08.019188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8a2fb-1cb7-48ac-a0d6-03e8b393df30 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.030118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 310/632] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:07 2022] POST /identity/v3/services => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:08.038062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:08.075451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.076094 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.076390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.076694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.087560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:08.089341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:08.106100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:08.107096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:08.108031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:08.110575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 323/633] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:08.111742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:08.179664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084dc28-07e2-45d2-aa90-bbe834112272 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.220584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:08.230877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.231550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.231756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.234054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.234054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] RBAC: Adding query filter params (role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=fdcfc478d70e4bc388cfd0dff157a817) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:08.234054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:08.234302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e5284-42da-47ff-ab70-9bcf398df359 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.235903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.242879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 311/634] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:08 2022] GET /identity/v3/role_assignments?user.id=fdcfc478d70e4bc388cfd0dff157a817&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:08.243526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:08.276451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.277568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.278384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.278980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.279888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:08.282585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.299640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:08.372106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfd5d1-6fc6-42c0-ac8f-083cadc73273 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.375394 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 324/635] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:08.422652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8f2f6-ba60-47f8-89cf-dad4a7f6c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.423366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f2f6-ba60-47f8-89cf-dad4a7f6c6fe None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.423762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f2f6-ba60-47f8-89cf-dad4a7f6c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.424142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8f2f6-ba60-47f8-89cf-dad4a7f6c6fe None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.425029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8f2f6-ba60-47f8-89cf-dad4a7f6c6fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:08.425406 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8f2f6-ba60-47f8-89cf-dad4a7f6c6fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:08.426959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8f2f6-ba60-47f8-89cf-dad4a7f6c6fe None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.447744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 312/636] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:08.454053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:08.588883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238852f-00da-46b7-b377-79765d6cd32f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:08.628958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732f8d2-9c97-4389-b894-773d2e400869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:08.629560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732f8d2-9c97-4389-b894-773d2e400869 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:08.629832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732f8d2-9c97-4389-b894-773d2e400869 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:08.630096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732f8d2-9c97-4389-b894-773d2e400869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:08.630810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732f8d2-9c97-4389-b894-773d2e400869 None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=7037b6179bdd434db3780d97d20060bd) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:08.631194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732f8d2-9c97-4389-b894-773d2e400869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:08.632725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732f8d2-9c97-4389-b894-773d2e400869 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:08.639738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 325/637] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:08 2022] GET /identity/v3/role_assignments?user.id=7037b6179bdd434db3780d97d20060bd&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:09.909617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d545fa3-0476-46d3-8cc7-bb8e436e050c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.910131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d545fa3-0476-46d3-8cc7-bb8e436e050c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.910131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d545fa3-0476-46d3-8cc7-bb8e436e050c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.911768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 313/638] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:09.917728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b59e0-5360-4d8f-8f38-32bd0f25eafc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:09.918134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b59e0-5360-4d8f-8f38-32bd0f25eafc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:09.918298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b59e0-5360-4d8f-8f38-32bd0f25eafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:09.937175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8d9b59e0-5360-4d8f-8f38-32bd0f25eafc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:09.938343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8d9b59e0-5360-4d8f-8f38-32bd0f25eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:09.993665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.012543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 326/639] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:09 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:10.281047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d545fa3-0476-46d3-8cc7-bb8e436e050c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.334999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.390665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d545fa3-0476-46d3-8cc7-bb8e436e050c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.430947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818164e-7dda-42a0-adb9-33ee2861fa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.431579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818164e-7dda-42a0-adb9-33ee2861fa7c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.431853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818164e-7dda-42a0-adb9-33ee2861fa7c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.432116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818164e-7dda-42a0-adb9-33ee2861fa7c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.432724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818164e-7dda-42a0-adb9-33ee2861fa7c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.434096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818164e-7dda-42a0-adb9-33ee2861fa7c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9818164e-7dda-42a0-adb9-33ee2861fa7c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:10.443190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:10.444755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:10.445615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:10.448537 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 314/640] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:10.451215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b59e0-5360-4d8f-8f38-32bd0f25eafc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.525237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dba872-c35d-4207-84ee-20b26a61b662 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.525514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dba872-c35d-4207-84ee-20b26a61b662 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.525942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dba872-c35d-4207-84ee-20b26a61b662 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.527624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 315/641] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:10.533697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd974-c3ff-4a4b-8aaf-ad4782a0594e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.533897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd974-c3ff-4a4b-8aaf-ad4782a0594e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.534138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd974-c3ff-4a4b-8aaf-ad4782a0594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.554089 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-272cd974-c3ff-4a4b-8aaf-ad4782a0594e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:10.555278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-272cd974-c3ff-4a4b-8aaf-ad4782a0594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:10.573162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b59e0-5360-4d8f-8f38-32bd0f25eafc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.616222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.617120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.617400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.617666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.618675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:10.618980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.620333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.628464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 327/642] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:10.633205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:10.643291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 316/643] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:10.645227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a378f01-414b-4fce-8dd2-15858d754a2c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.645507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a378f01-414b-4fce-8dd2-15858d754a2c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.645774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a378f01-414b-4fce-8dd2-15858d754a2c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.648353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 317/644] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:10.653057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce8eb-90db-49de-a185-b1ab8defdf88 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.653438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce8eb-90db-49de-a185-b1ab8defdf88 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.653803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ce8eb-90db-49de-a185-b1ab8defdf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.676183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1c4ce8eb-90db-49de-a185-b1ab8defdf88 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:10.677540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c4ce8eb-90db-49de-a185-b1ab8defdf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:10.698958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.723064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:10.752316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587b4b-542e-49bd-9b82-8f865b3fa334 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:10.758064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 318/645] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:10.793152 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0afa19-43fc-4adf-9d28-360f1acbafee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:10.793669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afa19-43fc-4adf-9d28-360f1acbafee None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.793946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afa19-43fc-4adf-9d28-360f1acbafee None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.794214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0afa19-43fc-4adf-9d28-360f1acbafee None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.794852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0afa19-43fc-4adf-9d28-360f1acbafee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:10.795152 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0afa19-43fc-4adf-9d28-360f1acbafee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:10.796542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0afa19-43fc-4adf-9d28-360f1acbafee None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:10.808573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 328/646] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:10.889407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf509e6-79af-4397-9c4e-2df1ab6f1ecc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.889738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf509e6-79af-4397-9c4e-2df1ab6f1ecc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.889953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf509e6-79af-4397-9c4e-2df1ab6f1ecc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.891621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 319/647] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:10.897468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9121-3a22-4d09-8f6d-56681c8bccec None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:10.897755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9121-3a22-4d09-8f6d-56681c8bccec None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:10.898017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9121-3a22-4d09-8f6d-56681c8bccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:10.917416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ad9c9121-3a22-4d09-8f6d-56681c8bccec None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:10.918612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ad9c9121-3a22-4d09-8f6d-56681c8bccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:10.933939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf509e6-79af-4397-9c4e-2df1ab6f1ecc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.010558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 329/648] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:10 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:11.033248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c9121-3a22-4d09-8f6d-56681c8bccec None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.060458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf509e6-79af-4397-9c4e-2df1ab6f1ecc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.093315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.099734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.100642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.101400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.101935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.102674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.104213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.113514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.114482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:11.115924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:11.124813 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 320/649] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Nov 2 07:23:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:11.133194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.155104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c9121-3a22-4d09-8f6d-56681c8bccec None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.206188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.207130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.207422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.207698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.208856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.221019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:11.228158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.229137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:11.229971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:11.232527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 330/650] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:11.235158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.256541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b1c1b-c92f-4fbb-ab60-78cc5fcb3676 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.292485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.293119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.293392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.293657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.294275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.294569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.295939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.300485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 321/651] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.301212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.359407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd044-9d1c-48c0-8c52-cb45199f30e1 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.367417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.394360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.394960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.395236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.395497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.396149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.396522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.397900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.406607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 331/652] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:11.407380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.412995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.416314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af60131-0b74-4dfc-a2e9-ff8f48d8c300 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.452193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.452845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.453124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.453398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.453977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.455375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.464083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.470074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:11.471193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 322/653] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:11.472186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.524077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaabcd-86e6-4ad1-960e-83d8dfa8de85 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.560298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.561019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.561362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.561910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.562250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.562545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.563906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.569071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 332/654] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.569671 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.579111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f265b1-d9be-419d-b3d7-91cc4f08eeb2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.602099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.617363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.617928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.618203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.618475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.629422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.630855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:11.647715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:11.648879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:11.649944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:11.649944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:11.649944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:11.656314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 323/655] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:11.656314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.673815 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.682707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d364cf-67a2-4f62-b7c3-fe0cf3432827 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.725380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.726002 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.726276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.726540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.727179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.727473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.728924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.734048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 333/656] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.734890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.774345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5560-73fd-46aa-943b-a643d01ca639 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.808848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.809446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.809721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.809989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.810676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] RBAC: Adding query filter params (interface=public, service_id=fda956e26a2240d4b1a227472c9a1e38, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.810976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.812324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.817533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 324/657] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/endpoints?service_id=fda956e26a2240d4b1a227472c9a1e38&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.822660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.837214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.842802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75055298-460b-4a3e-bba8-41eb1ca4b63a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.880417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.881080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.881353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.881617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.882243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.882539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.883878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.900666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 334/658] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.900666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:11.916856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:11.938044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67df07-b6a7-420a-badb-84084a078174 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:11.975897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:11.976528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:11.976810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:11.977079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:11.977698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:11.977997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:11.979389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:11.983964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 325/659] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:11.984712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.019153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380971-7e13-48b5-9f95-75899d9c9317 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.061847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.062572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.062975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.063345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.064181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.065892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.073412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 335/660] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/services => generated 1029 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:12.117454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b82546-b0b4-4237-9451-fb2b81e3b141 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.160759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.161337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.161617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.161889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.171374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.172890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:12.185973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:12.187051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:12.188247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 326/661] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:23:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:12.193365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.219242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.308143 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b03c86-c7d0-4503-96da-8e5c26521e94 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.345103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.345755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.346095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.346372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.347155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:12.347460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.348912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.367942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 336/662] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:12.373620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.377649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.480370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a28fd-8671-40af-b8f5-fad57f123092 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.515972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.516636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.516970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.517248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.528579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.530038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:12.544554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:12.545543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:12.546461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:12.546461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:12.546461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:12.546461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 327/663] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:12.551322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.635702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.658052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6034f5-bca8-4b0e-af67-004e2c3a2341 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.695843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.696862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.697335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.697793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.698615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:12.699101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.700753 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.713130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 337/664] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:12.721307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:12.777546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:12.825185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c7c8-9c5a-4afb-8ae3-72777b3e709b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:12.860572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b4e90-886c-4a5f-8526-d3b3cbe89e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:12.861202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4e90-886c-4a5f-8526-d3b3cbe89e6c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:12.861474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4e90-886c-4a5f-8526-d3b3cbe89e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:12.861739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b4e90-886c-4a5f-8526-d3b3cbe89e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:12.869326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b4e90-886c-4a5f-8526-d3b3cbe89e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:12.870775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b4e90-886c-4a5f-8526-d3b3cbe89e6c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-615b4e90-886c-4a5f-8526-d3b3cbe89e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:12.882121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:12.883047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:12.883962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 328/665] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:12.890916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:13.005094 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36249909-9926-4f06-b5d9-ce5b5c630812 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:13.020044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb13696-5a15-474c-a491-7d15faf7b018 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.020590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb13696-5a15-474c-a491-7d15faf7b018 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.020590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb13696-5a15-474c-a491-7d15faf7b018 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.021967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 329/666] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:13.028191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa479d1-760d-47c6-a4ee-4ed4c18892ed None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.028702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa479d1-760d-47c6-a4ee-4ed4c18892ed None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.029165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa479d1-760d-47c6-a4ee-4ed4c18892ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.046234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:13.046959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.047126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.047362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.048050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:13.048352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:13.049800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:13.052268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8aa479d1-760d-47c6-a4ee-4ed4c18892ed None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:13.054227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8aa479d1-760d-47c6-a4ee-4ed4c18892ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:13.057891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:13.063821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 338/667] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:13.072904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:13.136458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 330/668] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:13.187991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc18206-27cb-4e07-ac32-e6439a4b4022 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:13.222960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77693f0-df46-486e-b8b5-8d5e8504abe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:13.223611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77693f0-df46-486e-b8b5-8d5e8504abe2 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.223888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77693f0-df46-486e-b8b5-8d5e8504abe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.224162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77693f0-df46-486e-b8b5-8d5e8504abe2 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/fdcfc478d70e4bc388cfd0dff157a817/roles/1ef1703c4f474ae9aa4291d7dee6b894` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.226935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77693f0-df46-486e-b8b5-8d5e8504abe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=fdcfc478d70e4bc388cfd0dff157a817, role_id=1ef1703c4f474ae9aa4291d7dee6b894)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:13.228374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77693f0-df46-486e-b8b5-8d5e8504abe2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:13.316227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 339/669] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:13 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/fdcfc478d70e4bc388cfd0dff157a817/roles/1ef1703c4f474ae9aa4291d7dee6b894 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:13.413461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa479d1-760d-47c6-a4ee-4ed4c18892ed None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:13.466726 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:13.524338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa479d1-760d-47c6-a4ee-4ed4c18892ed None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:13.559447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c11479-3d03-415b-8e27-9bcda85fd8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:13.560380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11479-3d03-415b-8e27-9bcda85fd8c1 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:13.560873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11479-3d03-415b-8e27-9bcda85fd8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:13.561333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c11479-3d03-415b-8e27-9bcda85fd8c1 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:13.562163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c11479-3d03-415b-8e27-9bcda85fd8c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:13.563732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c11479-3d03-415b-8e27-9bcda85fd8c1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:13.659567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 331/670] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:13 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:14.283643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45732c6-2335-4923-9875-e51a7bc28880 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.284171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45732c6-2335-4923-9875-e51a7bc28880 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.284171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45732c6-2335-4923-9875-e51a7bc28880 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.285926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 340/671] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:14.292217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cea7b-cf22-4752-b590-bfbb054fc0cf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.292730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cea7b-cf22-4752-b590-bfbb054fc0cf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.292806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cea7b-cf22-4752-b590-bfbb054fc0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.311479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3d6cea7b-cf22-4752-b590-bfbb054fc0cf None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:14.312677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3d6cea7b-cf22-4752-b590-bfbb054fc0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:14.384793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c87be-fa00-4c6d-9436-f06b44eed06e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.384793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c87be-fa00-4c6d-9436-f06b44eed06e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.385043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c87be-fa00-4c6d-9436-f06b44eed06e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.387591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 341/672] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:14.390245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 332/673] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:14.395028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7458e6-5757-4196-ab42-ebdf743ec7a3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.395028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7458e6-5757-4196-ab42-ebdf743ec7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.395028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7458e6-5757-4196-ab42-ebdf743ec7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.410863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dc7458e6-5757-4196-ab42-ebdf743ec7a3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:14.412594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dc7458e6-5757-4196-ab42-ebdf743ec7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:14.467594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:14.488540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 342/674] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:14.657100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cea7b-cf22-4752-b590-bfbb054fc0cf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.687539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:14.756998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7458e6-5757-4196-ab42-ebdf743ec7a3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:14.758856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cea7b-cf22-4752-b590-bfbb054fc0cf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.805123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:14.805722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.805998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.806265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.806961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:14.808456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:14.872838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7458e6-5757-4196-ab42-ebdf743ec7a3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:14.886178 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 333/675] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:14 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:14.924879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:14.925448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:14.925773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:14.926087 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:14.926738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:14.928511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:14.938808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:14.939847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:14.940976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 343/676] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:14.949297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.053536 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.063280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7580d-71aa-4a0c-b56d-345395b09b7d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.099371 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.100016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.100293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.100611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.101300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:15.101599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.102961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.108334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 334/677] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:15.113667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.171231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.225126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72f40e-7acf-4247-84f8-fce7edf0db47 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.260083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7d5ee-43a0-4873-bc23-d50171e8afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.260705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d5ee-43a0-4873-bc23-d50171e8afb5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.260985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d5ee-43a0-4873-bc23-d50171e8afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.261257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7d5ee-43a0-4873-bc23-d50171e8afb5 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.261883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7d5ee-43a0-4873-bc23-d50171e8afb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:15.262184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7d5ee-43a0-4873-bc23-d50171e8afb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.263611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7d5ee-43a0-4873-bc23-d50171e8afb5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.269086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 344/678] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:15.275098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.390710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acc9b4-4a46-4868-909e-c7f1f70c6f50 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:15.428729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98c2da-71ba-4997-af7d-5d4eb278379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:15.429371 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c2da-71ba-4997-af7d-5d4eb278379e None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.429653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c2da-71ba-4997-af7d-5d4eb278379e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.429925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c2da-71ba-4997-af7d-5d4eb278379e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.430629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98c2da-71ba-4997-af7d-5d4eb278379e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:15.432055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98c2da-71ba-4997-af7d-5d4eb278379e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:15.514609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 335/679] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:15.549413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc411-31d2-4930-a600-624c95c7d76c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.549937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc411-31d2-4930-a600-624c95c7d76c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.549937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc411-31d2-4930-a600-624c95c7d76c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.551641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 345/680] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:15.557935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0764-9a51-43d5-9c0b-05ae9cb1ad37 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.558274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0764-9a51-43d5-9c0b-05ae9cb1ad37 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.558550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e0764-9a51-43d5-9c0b-05ae9cb1ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:15.579495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c67e0764-9a51-43d5-9c0b-05ae9cb1ad37 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:15.580732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c67e0764-9a51-43d5-9c0b-05ae9cb1ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:15.589752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:15.665491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 336/681] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:15.938091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dc411-31d2-4930-a600-624c95c7d76c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:15.999307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e7ef-58f7-4fcf-b705-365219167cbb None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:15.999635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e7ef-58f7-4fcf-b705-365219167cbb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:15.999849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3e7ef-58f7-4fcf-b705-365219167cbb None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.001464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 337/682] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:16.006442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc96f9e-5ded-4cc1-bd32-286a9779bf7f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.006722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc96f9e-5ded-4cc1-bd32-286a9779bf7f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.006994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc96f9e-5ded-4cc1-bd32-286a9779bf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.025236 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-efc96f9e-5ded-4cc1-bd32-286a9779bf7f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:16.026402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-efc96f9e-5ded-4cc1-bd32-286a9779bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:16.052181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dc411-31d2-4930-a600-624c95c7d76c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.072367 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.100536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.101815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.102323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.102765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.112791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 338/683] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:16.114661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:16.119942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:16.121130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:16.122252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:16.124654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 346/684] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:16.133321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc96f9e-5ded-4cc1-bd32-286a9779bf7f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.204900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.241194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc96f9e-5ded-4cc1-bd32-286a9779bf7f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.279230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.280083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.280787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.281201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.282055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.282521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.284033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.293875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 339/685] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:16.301523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.409417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d23f9f-a63a-4508-acd2-ef355c1375c3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.413323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.456009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.457312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.457810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.458222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.472869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.475090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:16.491345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:16.492526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:16.493460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:16.493460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:16.493460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:16.497023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 347/686] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:16.499303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.527919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.536490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41b45-a849-4bd7-baaf-e8f4fce07d88 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.573063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.584735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.585372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.585644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.585905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.586480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.587886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:16.602555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:16.603591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:16.604486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:16.608577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 340/687] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:16.612861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.620652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727a98-287a-4a27-a76f-b367332debe8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.657865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.658552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.658799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.659067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.659709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.660020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.661419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.678480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 348/688] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:16.679489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.742734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d8a3-7405-4e2b-93a3-b94e84a0fe16 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.786396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.786621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.787769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.788616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.789110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.789943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.790445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.792831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.799602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 341/689] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:16.804480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f0a1-acba-4bd3-841c-414a37c809ed None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.813416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.853623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.855503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.855988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.856530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.865932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.867775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.880508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:16.883907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:16.884958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 07:23:16.885946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:16.893504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 349/690] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:16.900716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:16.937922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ce80c-7afe-48ca-9a3e-2c7c062e1107 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:16.977054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:16.977746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:16.978022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:16.978270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:16.979123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:16.979427 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:16.980810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:16.988538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 342/691] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:16.993351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.025562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5984b-3eff-4f0c-8282-501b39f7e73e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.066833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.067752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.068230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.069172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.070065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:17.070518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.072219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.091489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 350/692] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:17.097157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.100486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.132003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516806-c90c-49a0-87b3-9afc64fe0457 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.162919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.176255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3057d-0c49-40cf-90ba-43e9587bdc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.177165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3057d-0c49-40cf-90ba-43e9587bdc53 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.178161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3057d-0c49-40cf-90ba-43e9587bdc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.178700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3057d-0c49-40cf-90ba-43e9587bdc53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.179397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3057d-0c49-40cf-90ba-43e9587bdc53 None admin] RBAC: Adding query filter params (interface=public, service_id=dff697d77661471db69a0dabe3923fea, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:17.179698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3057d-0c49-40cf-90ba-43e9587bdc53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.181137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3057d-0c49-40cf-90ba-43e9587bdc53 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.190985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 343/693] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:16 2022] GET /identity/v3/endpoints?service_id=dff697d77661471db69a0dabe3923fea&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:17.192313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ed86-c09f-4b5d-9e3a-a99ca2a9a739 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.192583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ed86-c09f-4b5d-9e3a-a99ca2a9a739 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.192850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ed86-c09f-4b5d-9e3a-a99ca2a9a739 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.198874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 344/694] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:17.198874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946ed86-c09f-4b5d-9e3a-a99ca2a9a739 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.212296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9535d-0578-4024-b5c3-3475983d1a51 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.249424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.249942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.250215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.250481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.306319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946ed86-c09f-4b5d-9e3a-a99ca2a9a739 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.321054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.322554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.324576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.342025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b505-7c6a-4c49-a7d4-4de10013a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.342885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b505-7c6a-4c49-a7d4-4de10013a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.343344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b505-7c6a-4c49-a7d4-4de10013a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.343607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b505-7c6a-4c49-a7d4-4de10013a3d4 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.344213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b505-7c6a-4c49-a7d4-4de10013a3d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.345600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b505-7c6a-4c49-a7d4-4de10013a3d4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.352751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 345/695] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:17.354031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf0ab1-8a9d-4552-a9d4-e2e368ce36f1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.354318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf0ab1-8a9d-4552-a9d4-e2e368ce36f1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.354588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf0ab1-8a9d-4552-a9d4-e2e368ce36f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.387304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1ccf0ab1-8a9d-4552-a9d4-e2e368ce36f1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:17.388781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1ccf0ab1-8a9d-4552-a9d4-e2e368ce36f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.448203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.457708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 351/696] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:17.464627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.472984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 346/697] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:17.574529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e063c-5bbe-4d03-a6b3-69df87eb8cf8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.576478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.612982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c5b8-794b-4d3d-b7a7-9ca9ef6277ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.613703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5b8-794b-4d3d-b7a7-9ca9ef6277ef None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.613983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5b8-794b-4d3d-b7a7-9ca9ef6277ef None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.614257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c5b8-794b-4d3d-b7a7-9ca9ef6277ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.626825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9c5b8-794b-4d3d-b7a7-9ca9ef6277ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.628373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9c5b8-794b-4d3d-b7a7-9ca9ef6277ef None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b5b9c5b8-794b-4d3d-b7a7-9ca9ef6277ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:17.645267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:17.646846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:17.648509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:17.648509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:17.648509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:17.648509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 352/698] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:17.653031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf0ab1-8a9d-4552-a9d4-e2e368ce36f1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.729390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65c755-5e42-40cd-9420-355f5ed22193 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.729390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65c755-5e42-40cd-9420-355f5ed22193 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.729390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65c755-5e42-40cd-9420-355f5ed22193 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.741759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 353/699] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:17.741759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4886b-3487-47eb-a7bb-4f7692e86d6f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.741759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4886b-3487-47eb-a7bb-4f7692e86d6f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.741759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4886b-3487-47eb-a7bb-4f7692e86d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.760880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-83b4886b-3487-47eb-a7bb-4f7692e86d6f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:17.761936 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf0ab1-8a9d-4552-a9d4-e2e368ce36f1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.762112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-83b4886b-3487-47eb-a7bb-4f7692e86d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:17.801397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.801999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.802273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.802576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.803223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:17.803522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.804926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.820711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 347/700] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:17.822390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.836104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 354/701] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:17.845343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4886b-3487-47eb-a7bb-4f7692e86d6f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:17.866548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.928330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95db8e-fc7c-4769-8fe5-fbb37988ca14 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.955151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:17.965482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:17.966330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:17.979007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:17.979007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:17.979007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:17.979007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:17.979343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4886b-3487-47eb-a7bb-4f7692e86d6f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:17.979452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:17.980528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:17.981516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:17.982733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 348/702] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:17.988412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.020207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.020865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.021143 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.022337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.030606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.032469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:18.046865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:18.047971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:18.049321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 355/703] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:18.053975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.098495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46de98-750e-411b-8968-5d22e90b5354 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.102314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.141484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.142092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.142370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.142736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.143377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.143676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.145177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.157288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 349/704] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:18.157288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.176615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7bd4-13af-417b-a135-01efb85cf05b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.212861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.213541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.213804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.214074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.214757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.215060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.216503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.228521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 356/705] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:18.234067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.238628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.263994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777e16-1102-4090-bb14-8e581be3b743 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.300519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.301158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.301441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.301710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.302297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.304220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:18.313694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:18.315005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:18.315870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 350/706] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:18.317599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.342372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec32ed9-c654-4291-80d8-912338cc43b9 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.351652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.376754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.377356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.377634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.377904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.378526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.378825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.380177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.390210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 357/707] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:18.390210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.433313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5f5c-c0e8-4880-aef2-30900ff47194 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.457977 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.468025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.468691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.470509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.470509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.470509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] RBAC: Adding query filter params (role.id=1ef1703c4f474ae9aa4291d7dee6b894, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=fdcfc478d70e4bc388cfd0dff157a817) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.470509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.471705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.478034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 351/708] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/role_assignments?user.id=fdcfc478d70e4bc388cfd0dff157a817&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=1ef1703c4f474ae9aa4291d7dee6b894 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:18.478881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.503191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfe894-ddcc-4765-bc4f-7003dd0c24c3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.557921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.558616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.558841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.559112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.559760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.560059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.561489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.567310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 358/709] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:18.573334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.600062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.608541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d2bbc-df5b-4f0a-83ce-021f423b91dc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.660919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.661559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.661883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.662159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.662898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] RBAC: Adding query filter params (interface=public, service_id=b00038d3b01e4c1881388f1a57118b8c, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.663207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.664611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.671794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 352/710] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/endpoints?service_id=b00038d3b01e4c1881388f1a57118b8c&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:18.679030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:18.707595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7843a1-bfea-49eb-90d3-d326d994394d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.746851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:18.753008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42aa28-de73-4a07-8bec-3ac0e0bd0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.753613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42aa28-de73-4a07-8bec-3ac0e0bd0165 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.754589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42aa28-de73-4a07-8bec-3ac0e0bd0165 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.754862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42aa28-de73-4a07-8bec-3ac0e0bd0165 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.755482 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42aa28-de73-4a07-8bec-3ac0e0bd0165 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:18.755777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42aa28-de73-4a07-8bec-3ac0e0bd0165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.758045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42aa28-de73-4a07-8bec-3ac0e0bd0165 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.765360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 359/711] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:18.812589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e9fbd-63eb-48cd-9bc2-a8a6f3b5c4bf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:18.851693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe01f-ff82-4f72-bb93-41f0b97a9d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:18.852681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe01f-ff82-4f72-bb93-41f0b97a9d7a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:18.853099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe01f-ff82-4f72-bb93-41f0b97a9d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:18.853569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe01f-ff82-4f72-bb93-41f0b97a9d7a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:18.854323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe01f-ff82-4f72-bb93-41f0b97a9d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:18.855845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe01f-ff82-4f72-bb93-41f0b97a9d7a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:18.863283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 353/712] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:18 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:23:19.594784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75236869-874a-47d6-91d9-849150dfc87c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.595161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75236869-874a-47d6-91d9-849150dfc87c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.595339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75236869-874a-47d6-91d9-849150dfc87c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.596969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 360/713] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:19.602921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547192-6c0c-4499-bb2c-26e20966ed20 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:19.603360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547192-6c0c-4499-bb2c-26e20966ed20 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:19.603548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56547192-6c0c-4499-bb2c-26e20966ed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:19.622304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-56547192-6c0c-4499-bb2c-26e20966ed20 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:19.623481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-56547192-6c0c-4499-bb2c-26e20966ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:19.640876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:19.692413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 354/714] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:19.970860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75236869-874a-47d6-91d9-849150dfc87c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.077392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75236869-874a-47d6-91d9-849150dfc87c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.112865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.113484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.113757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.114022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.114594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.118452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:20.131379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:20.132407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:20.133608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 361/715] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:20.138456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547192-6c0c-4499-bb2c-26e20966ed20 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.243846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56547192-6c0c-4499-bb2c-26e20966ed20 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.279279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.279887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.280163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.280717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.281344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:20.281646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.283083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.288244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 355/716] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:20.297495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.358574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.400856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606565d9-0166-43a6-b9b4-2197650b7b9d None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.437093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175550d6-87a5-415f-b4b7-d53aadde3ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.437698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175550d6-87a5-415f-b4b7-d53aadde3ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.437975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175550d6-87a5-415f-b4b7-d53aadde3ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.438245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175550d6-87a5-415f-b4b7-d53aadde3ad1 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.438873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175550d6-87a5-415f-b4b7-d53aadde3ad1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:20.439173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175550d6-87a5-415f-b4b7-d53aadde3ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.440584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175550d6-87a5-415f-b4b7-d53aadde3ad1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.446574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 362/717] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Nov 2 07:23:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:20.452230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:20.472586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.557255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca17c-7724-430f-a190-e97504d92360 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:20.596833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5963455-b51f-4fd9-8681-f50ac4c05e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:20.597448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963455-b51f-4fd9-8681-f50ac4c05e6a None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.597723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963455-b51f-4fd9-8681-f50ac4c05e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.597987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5963455-b51f-4fd9-8681-f50ac4c05e6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.598664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5963455-b51f-4fd9-8681-f50ac4c05e6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:20.600052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5963455-b51f-4fd9-8681-f50ac4c05e6a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:20.673596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 356/718] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:20.798530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bd22-a540-44d2-8ffc-5cb4c6923bf6 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.798530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bd22-a540-44d2-8ffc-5cb4c6923bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.798530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bd22-a540-44d2-8ffc-5cb4c6923bf6 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.799537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 363/719] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:20.809505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be681-fc83-4dcf-96c1-97ff844ee13e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:20.809505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be681-fc83-4dcf-96c1-97ff844ee13e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:20.809505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53be681-fc83-4dcf-96c1-97ff844ee13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:20.827756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c53be681-fc83-4dcf-96c1-97ff844ee13e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:20.829372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c53be681-fc83-4dcf-96c1-97ff844ee13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:20.903022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:20.909528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 357/720] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:21.091893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6356a-9c98-4bfe-a656-cb601ffc33e0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.092399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6356a-9c98-4bfe-a656-cb601ffc33e0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.092399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6356a-9c98-4bfe-a656-cb601ffc33e0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.094059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 364/721] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:21.099940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dbf62-70a4-46e6-923a-138177e5c713 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.100214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dbf62-70a4-46e6-923a-138177e5c713 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.100502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1dbf62-70a4-46e6-923a-138177e5c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.117402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ffc08-532c-4844-bdf6-284fe38ffdb3 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.117678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ffc08-532c-4844-bdf6-284fe38ffdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.117952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ffc08-532c-4844-bdf6-284fe38ffdb3 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.119581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 365/722] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:21.124569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb948c-ab8e-42a0-90fb-29a25684fd0b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.125038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb948c-ab8e-42a0-90fb-29a25684fd0b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.125989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb948c-ab8e-42a0-90fb-29a25684fd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.129025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2f1dbf62-70a4-46e6-923a-138177e5c713 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:21.130215 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2f1dbf62-70a4-46e6-923a-138177e5c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:21.147936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d1eb948c-ab8e-42a0-90fb-29a25684fd0b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:21.149817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d1eb948c-ab8e-42a0-90fb-29a25684fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:21.202725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 358/723] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:21.203960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dbf62-70a4-46e6-923a-138177e5c713 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.233971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 366/724] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:21.308721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1dbf62-70a4-46e6-923a-138177e5c713 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.337914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.343969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.344566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.344848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.345118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] PATH_INFO: `/v3/services/image` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.345693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.347059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:21.356493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:21.360506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:21.361383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 359/725] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:21.363700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb948c-ab8e-42a0-90fb-29a25684fd0b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.422220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.468365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb948c-ab8e-42a0-90fb-29a25684fd0b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.486600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.507561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.508592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.509090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.509996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.510985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] RBAC: Adding query filter params (name=image) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:21.511658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.513687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.520323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 367/726] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:21.521975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.593115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f192382-fefb-4177-b3c3-0463bb15e599 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.631853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.632643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.632968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.633646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.634260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.635680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.636053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f9f3-132d-4b85-bc60-61d5baf59f71 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:21.647408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:21.648680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:21.649782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 360/727] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:21.650755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.660651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.680182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.680756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.681034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.681358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.682065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.683370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.713721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:21.752586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033dcaa-a588-4f3e-a811-55c5f5ff9bf2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.759275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 368/728] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:21 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:21.760610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:21.821069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.822042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.822526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.823122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.824067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] RBAC: Adding query filter params (type=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:21.824671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.826378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.834617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 361/729] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:21.893991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c01ca2-c53d-41c8-8549-af23eacf1746 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:21.935737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:21.936376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:21.936685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:21.936951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:21.937610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:21.937905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:21.939339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:21.946724 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 369/730] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:21.952770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.067304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8662655-eeb3-4d34-ab79-236817eedf4f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.085920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.103202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97993c3-4931-4f71-8d51-8399cd4eb15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.103792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97993c3-4931-4f71-8d51-8399cd4eb15a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.104067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97993c3-4931-4f71-8d51-8399cd4eb15a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.104335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97993c3-4931-4f71-8d51-8399cd4eb15a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.113677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97993c3-4931-4f71-8d51-8399cd4eb15a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:22.113677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97993c3-4931-4f71-8d51-8399cd4eb15a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.113677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97993c3-4931-4f71-8d51-8399cd4eb15a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.113677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 362/731] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:22.118548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:22.165102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:22.223671 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3057-1407-43bc-b1e1-7055ee19a7c0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:22.258858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71558-ec15-4ede-9015-63aa5f0d5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:22.259462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71558-ec15-4ede-9015-63aa5f0d5ee5 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.259733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71558-ec15-4ede-9015-63aa5f0d5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.259998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71558-ec15-4ede-9015-63aa5f0d5ee5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.260695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71558-ec15-4ede-9015-63aa5f0d5ee5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:22.262045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71558-ec15-4ede-9015-63aa5f0d5ee5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:22.347617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 370/732] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:22.945747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7279c2-dfb7-429a-9a9a-26c3bb605ad6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.946300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7279c2-dfb7-429a-9a9a-26c3bb605ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.946300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7279c2-dfb7-429a-9a9a-26c3bb605ad6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.947901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 363/733] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:22.953163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3618061-361f-4a6e-ad4e-a27b34819e97 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:22.953681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3618061-361f-4a6e-ad4e-a27b34819e97 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:22.954180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3618061-361f-4a6e-ad4e-a27b34819e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:22.972698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c3618061-361f-4a6e-ad4e-a27b34819e97 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:22.974763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c3618061-361f-4a6e-ad4e-a27b34819e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:23.052535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 371/734] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:23.321243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7279c2-dfb7-429a-9a9a-26c3bb605ad6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.428800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7279c2-dfb7-429a-9a9a-26c3bb605ad6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.464606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.465219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.465497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.465767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.466426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.467859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.470474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING keystone.server.flask.common [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 07:23:23.514903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:23.514903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:23.514903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [parameters: {'id': '3e738f03ef3f4287996431f44751cd68', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:23:23.514903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e738f03ef3f4287996431f44751cd68.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e738f03ef3f4287996431f44751cd68. Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:23.522651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:23:23.523447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Nov 02 07:23:23.524868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:23:23.525826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:23:23.527780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:23.529769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'id': '3e738f03ef3f4287996431f44751cd68', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.532142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:23.534055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e738f03ef3f4287996431f44751cd68. Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:23.537294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 364/735] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Nov 2 07:23:23 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:23.544496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3618061-361f-4a6e-ad4e-a27b34819e97 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.570427 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.648854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3618061-361f-4a6e-ad4e-a27b34819e97 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.686098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed1c7-8910-4d81-b02a-1b3e85b5f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.686889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed1c7-8910-4d81-b02a-1b3e85b5f362 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.687107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed1c7-8910-4d81-b02a-1b3e85b5f362 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.687271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed1c7-8910-4d81-b02a-1b3e85b5f362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.695280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ed1c7-8910-4d81-b02a-1b3e85b5f362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.696730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ed1c7-8910-4d81-b02a-1b3e85b5f362 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-888ed1c7-8910-4d81-b02a-1b3e85b5f362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:23.708191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:23.709213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:23.710360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 372/736] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:23.718105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:23.763060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:23.829594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ca8e7-f93d-45ab-98fa-8c1dc19087d2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:23.865267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f036-fd52-4dae-b914-24b389ca33e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:23.865876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f036-fd52-4dae-b914-24b389ca33e1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:23.866147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f036-fd52-4dae-b914-24b389ca33e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:23.866415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f036-fd52-4dae-b914-24b389ca33e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:23.867072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021f036-fd52-4dae-b914-24b389ca33e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:23.867369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021f036-fd52-4dae-b914-24b389ca33e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:23.869037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021f036-fd52-4dae-b914-24b389ca33e1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:23.890521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 365/737] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:24.140390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f834-eb2d-4f26-bbe6-3b7b0f035f36 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.140721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f834-eb2d-4f26-bbe6-3b7b0f035f36 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.140975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f834-eb2d-4f26-bbe6-3b7b0f035f36 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.142502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 373/738] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:24.154613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2233450-a2e4-438c-9e86-dfc9688237e6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.154613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2233450-a2e4-438c-9e86-dfc9688237e6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.154613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2233450-a2e4-438c-9e86-dfc9688237e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.155169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cea2f-c867-440e-ad81-a66b3a5ae0bf None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.155169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cea2f-c867-440e-ad81-a66b3a5ae0bf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.155169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cea2f-c867-440e-ad81-a66b3a5ae0bf None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.155169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 374/739] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:24.158068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b298350-5487-437f-8878-3ba8b274629c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.158541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b298350-5487-437f-8878-3ba8b274629c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.158983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b298350-5487-437f-8878-3ba8b274629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.168322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c2233450-a2e4-438c-9e86-dfc9688237e6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:24.169855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c2233450-a2e4-438c-9e86-dfc9688237e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:24.178794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6b298350-5487-437f-8878-3ba8b274629c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:24.179976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6b298350-5487-437f-8878-3ba8b274629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:24.243558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 366/740] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:24.257151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 375/741] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:24.513429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2233450-a2e4-438c-9e86-dfc9688237e6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.528243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b298350-5487-437f-8878-3ba8b274629c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.542763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.547013 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.615869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2233450-a2e4-438c-9e86-dfc9688237e6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.638121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b298350-5487-437f-8878-3ba8b274629c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.651253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f642cd-7cb3-46fb-9bd4-e6f9a7916268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.651866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f642cd-7cb3-46fb-9bd4-e6f9a7916268 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.652144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f642cd-7cb3-46fb-9bd4-e6f9a7916268 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.652413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f642cd-7cb3-46fb-9bd4-e6f9a7916268 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.653107 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f642cd-7cb3-46fb-9bd4-e6f9a7916268 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.654464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f642cd-7cb3-46fb-9bd4-e6f9a7916268 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.674512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8807943-5630-4e6b-aaa7-00e01fdafee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.675131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8807943-5630-4e6b-aaa7-00e01fdafee5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.675405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8807943-5630-4e6b-aaa7-00e01fdafee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.675671 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8807943-5630-4e6b-aaa7-00e01fdafee5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.676242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8807943-5630-4e6b-aaa7-00e01fdafee5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.677654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8807943-5630-4e6b-aaa7-00e01fdafee5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-b8807943-5630-4e6b-aaa7-00e01fdafee5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:24.686270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:24.687296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:24.688408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 376/742] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:24.689275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7dc0-b077-46b3-bcfc-3329eb503772 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.689275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7dc0-b077-46b3-bcfc-3329eb503772 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.689275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7dc0-b077-46b3-bcfc-3329eb503772 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.690705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 377/743] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:24.693725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b7dc0-b077-46b3-bcfc-3329eb503772 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.723995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 367/744] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:24 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:24.740505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82431e-2e83-4375-a66f-2a8470f21e4e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.740505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82431e-2e83-4375-a66f-2a8470f21e4e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.740505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82431e-2e83-4375-a66f-2a8470f21e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.765665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3d82431e-2e83-4375-a66f-2a8470f21e4e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:24.766401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3d82431e-2e83-4375-a66f-2a8470f21e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:24.797877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:24.832345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b7dc0-b077-46b3-bcfc-3329eb503772 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:24.860477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 368/745] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:24 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:24.886632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:24.887330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:24.887610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:24.887880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:24.888625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:24.888926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:24.890372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:24.897560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 378/746] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:24.903280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82431e-2e83-4375-a66f-2a8470f21e4e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:24.923834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:25.010459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82431e-2e83-4375-a66f-2a8470f21e4e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:25.047520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23879195-0f54-458e-9773-28977bc403ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:25.048466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879195-0f54-458e-9773-28977bc403ef None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.048940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879195-0f54-458e-9773-28977bc403ef None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.049418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23879195-0f54-458e-9773-28977bc403ef None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.050248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23879195-0f54-458e-9773-28977bc403ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:25.050737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23879195-0f54-458e-9773-28977bc403ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:25.052835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23879195-0f54-458e-9773-28977bc403ef None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.058345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 369/747] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:25.064233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:25.156552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23879195-0f54-458e-9773-28977bc403ef None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:25.191172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2c758-14c0-4b3c-b91e-8e1d9a54d81a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:25.231248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:25.231847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.232122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.232383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.233113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] RBAC: Adding query filter params (interface=public, service_id=e1a73561be274c71bcdb7b9508113f19, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:25.233415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:25.234763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.241614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 379/748] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:25 2022] GET /identity/v3/endpoints?service_id=e1a73561be274c71bcdb7b9508113f19&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:25.253417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:25.255367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:25.265217 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:25.278222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23879195-0f54-458e-9773-28977bc403ef None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:25.322367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:25.323759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.324245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.324754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.325540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:25.327968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:25.338819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:25.339830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:25.340816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:25.346867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 370/749] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:25.349385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:25.385294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5210c54-8eb4-4747-b1f3-e0f36511304c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:25.424030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:25.425095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.425642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.426126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.426918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:25.429290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.445034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 380/750] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:25 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:25.471723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df10345-efbb-41e3-9582-421292e1e3de None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:25.510377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:25.510998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.511274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.511543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.512177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:25.512497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:25.513890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.519893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 371/751] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:25.525935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:25.602134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:25.647105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495651-8d89-4c80-ac41-1ee26f303653 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:25.686735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:25.687340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.687615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.687885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.688540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:25.688842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:25.690196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.698736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 381/752] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:25.705252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:25.718965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:25.817729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554fb7-4cda-4d85-8077-0ac3cd3085e4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:25.856869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfffd5-dab6-4f2f-af9b-99b1987f5c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:25.857854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfffd5-dab6-4f2f-af9b-99b1987f5c24 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:25.858398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfffd5-dab6-4f2f-af9b-99b1987f5c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:25.858865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfffd5-dab6-4f2f-af9b-99b1987f5c24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:25.859780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfffd5-dab6-4f2f-af9b-99b1987f5c24 None admin] RBAC: Adding query filter params (interface=admin, service_id=b00038d3b01e4c1881388f1a57118b8c, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:25.860283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfffd5-dab6-4f2f-af9b-99b1987f5c24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:25.861879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfffd5-dab6-4f2f-af9b-99b1987f5c24 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:25.871208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 372/753] 10.222.0.39 () {56 vars in 1249 bytes} [Wed Nov 2 07:23:25 2022] GET /identity/v3/endpoints?service_id=b00038d3b01e4c1881388f1a57118b8c&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:25.877233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:25.985694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be4ebc-4224-4c89-b2d6-69633d170443 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.016612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:26.023944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31a317-84e5-4655-a5df-679b51e2396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.024888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a317-84e5-4655-a5df-679b51e2396b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.025372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a317-84e5-4655-a5df-679b51e2396b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.025867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a317-84e5-4655-a5df-679b51e2396b None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.026800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31a317-84e5-4655-a5df-679b51e2396b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:26.028366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31a317-84e5-4655-a5df-679b51e2396b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:26.035784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 382/754] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:25 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:23:26.198881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6ec4-942d-4a58-a7a6-f5ca7b7f79d7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.199437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6ec4-942d-4a58-a7a6-f5ca7b7f79d7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.199437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6ec4-942d-4a58-a7a6-f5ca7b7f79d7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.201063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 373/755] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:26.207029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1cc6-c2b7-4fad-8d17-bd13d569985b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.207319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1cc6-c2b7-4fad-8d17-bd13d569985b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.211667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab1cc6-c2b7-4fad-8d17-bd13d569985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.227937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b8ab1cc6-c2b7-4fad-8d17-bd13d569985b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:26.229146 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b8ab1cc6-c2b7-4fad-8d17-bd13d569985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:26.301226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 383/756] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:26 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:26.575493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6ec4-942d-4a58-a7a6-f5ca7b7f79d7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.652177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:26.678365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6ec4-942d-4a58-a7a6-f5ca7b7f79d7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.712476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.713083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.713359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.713625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.714271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:26.715752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:26.757469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:23:26.757469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:23:26.757469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [parameters: {'user_id': '37dc48a1171c4eeaa4c0d976152c952d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:23:26.757469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:26.765084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:26.765982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:23:26.766939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:23:26.767835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:26.768787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:26.769648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'user_id': '37dc48a1171c4eeaa4c0d976152c952d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:26.770485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 07:23:26.771323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 07:23:26.772261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 07:23:26.772261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 07:23:26.772261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:23:26.772261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:23:26.772261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 07:23:26.772261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:26.772261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 374/757] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Nov 2 07:23:26 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:26.775741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1cc6-c2b7-4fad-8d17-bd13d569985b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:26.888015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab1cc6-c2b7-4fad-8d17-bd13d569985b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:26.913410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:26.926484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6085a6-85d2-4a6a-aa99-4ff8d671460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:26.929281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6085a6-85d2-4a6a-aa99-4ff8d671460b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:26.929281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6085a6-85d2-4a6a-aa99-4ff8d671460b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:26.929281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6085a6-85d2-4a6a-aa99-4ff8d671460b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:26.937514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6085a6-85d2-4a6a-aa99-4ff8d671460b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:26.939419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6085a6-85d2-4a6a-aa99-4ff8d671460b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-1f6085a6-85d2-4a6a-aa99-4ff8d671460b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:26.954222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:26.955451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 07:23:26.956697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:26.958950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 384/758] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:26.965134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.040601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be615f-baac-447b-b4b0-3cd7ca774643 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.040881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be615f-baac-447b-b4b0-3cd7ca774643 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.041171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be615f-baac-447b-b4b0-3cd7ca774643 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.042745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 385/759] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:27.047648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc91e-7c9d-41fe-8abe-d59e1b04fc63 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.047927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc91e-7c9d-41fe-8abe-d59e1b04fc63 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.048196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc91e-7c9d-41fe-8abe-d59e1b04fc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.067414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bfbdc91e-7c9d-41fe-8abe-d59e1b04fc63 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:27.068884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bfbdc91e-7c9d-41fe-8abe-d59e1b04fc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:27.079930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a7985-74a7-48f8-b9a5-c54f5cf922ac None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.121735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.122877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.123325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.123802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.124782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:27.125324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.127100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.140704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.150959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 386/760] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:27.170870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 375/761] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Nov 2 07:23:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:27.420330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc91e-7c9d-41fe-8abe-d59e1b04fc63 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.526391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc91e-7c9d-41fe-8abe-d59e1b04fc63 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.541489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.560483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.561106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.561381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.561644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] PATH_INFO: `/v3/services/image` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.562221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.563567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:27.572007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:27.573033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:27.573914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 387/762] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:27.579206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.682912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7470-c3ba-4d73-aa91-e6290c52f9e9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.720145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225e000-0e6f-42db-8585-4461ac9fdcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.720775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225e000-0e6f-42db-8585-4461ac9fdcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.721048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225e000-0e6f-42db-8585-4461ac9fdcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.721318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225e000-0e6f-42db-8585-4461ac9fdcf0 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.721939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225e000-0e6f-42db-8585-4461ac9fdcf0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:27.722232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225e000-0e6f-42db-8585-4461ac9fdcf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.723603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225e000-0e6f-42db-8585-4461ac9fdcf0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.734457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 376/763] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:27.735715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:27.739480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae723b9c-0805-4dab-8d96-ef6d29978b07 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.739917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae723b9c-0805-4dab-8d96-ef6d29978b07 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.740182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae723b9c-0805-4dab-8d96-ef6d29978b07 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.741514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 377/764] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:27.746637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6481840-98ae-4e15-abfd-498816774705 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.746920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6481840-98ae-4e15-abfd-498816774705 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.747191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6481840-98ae-4e15-abfd-498816774705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.765531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f6481840-98ae-4e15-abfd-498816774705 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:27.767038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f6481840-98ae-4e15-abfd-498816774705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:27.829020 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:27.848868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 378/765] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:27 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:27.849324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b451fe-6200-465d-a97a-b1e9614acd24 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:27.887945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:27.888912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:27.889190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:27.889500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:27.890117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] RBAC: Adding query filter params (type=image) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:27.890410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:27.891836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:27.902382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 388/766] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:27.903530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6481840-98ae-4e15-abfd-498816774705 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.009061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6481840-98ae-4e15-abfd-498816774705 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.044251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.044990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.045274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.045535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.046233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] RBAC: Adding query filter params (interface=public, service_id=eab9fb8ad40c480aaf61df2d53a88ee8, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:28.046535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.048218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.059098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 379/767] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:23:27 2022] GET /identity/v3/endpoints?service_id=eab9fb8ad40c480aaf61df2d53a88ee8&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:28.060831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.106346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.128393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.179960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29398e88-881e-43df-9662-c2d56038d1ea None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.184954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.223241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.223897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.224169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.224496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.225332 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.226460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.236814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d666fa-37ed-417a-86cd-193bbf9c41d1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.241984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 389/768] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:23:28.280645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7b965-78d9-41e9-a42c-9739852b86a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.281219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7b965-78d9-41e9-a42c-9739852b86a7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.281498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7b965-78d9-41e9-a42c-9739852b86a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.281768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7b965-78d9-41e9-a42c-9739852b86a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.282361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7b965-78d9-41e9-a42c-9739852b86a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.283745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7b965-78d9-41e9-a42c-9739852b86a7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-46f7b965-78d9-41e9-a42c-9739852b86a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:28.295992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:28.297353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:28.301612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 380/769] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:28.304684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.426499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c123-a840-43f1-a190-5e6c236288ab None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.434937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.442205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b793-2929-47e7-a70e-b5bbd395bce9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.443087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b793-2929-47e7-a70e-b5bbd395bce9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.443322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b793-2929-47e7-a70e-b5bbd395bce9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.444818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 381/770] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:28.450719 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8480c-f42c-4a7f-8471-3eb6b003a5b6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.450995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8480c-f42c-4a7f-8471-3eb6b003a5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.451260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8480c-f42c-4a7f-8471-3eb6b003a5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.465894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.467118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.467399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.467675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.468513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:28.469041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.471507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.472096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-59a8480c-f42c-4a7f-8471-3eb6b003a5b6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:28.473301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-59a8480c-f42c-4a7f-8471-3eb6b003a5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:28.479504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 390/771] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:28.485086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.557011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 382/772] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:28 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:28.595850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fd2af-50f0-4418-b4cc-77bd2fa4af80 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.632979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.634010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.634495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.634881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.635906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:28.636212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.638106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.648328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 391/773] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:28.649967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8480c-f42c-4a7f-8471-3eb6b003a5b6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.703992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.759963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8480c-f42c-4a7f-8471-3eb6b003a5b6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:28.793446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:28.794044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:28.794316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:28.794579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:28.795244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:28.796647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:28.852127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:28.872753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 383/774] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:28.894454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:28.970241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ff51-69b6-49a7-bd22-7a003a5c3fe2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:29.014008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:29.014831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:29.015201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:29.015616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:29.016292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:29.017811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:29.028110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:29.029419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 07:23:29.030752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:29.032703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 392/775] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Nov 2 07:23:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:29.039041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:29.146503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189641f-b49a-433a-85f1-e27b205b37c2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:29.148228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:29.184185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:29.185014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:29.185358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:29.185699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:29.186400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:29.186770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:29.188201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:29.193811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 384/776] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:29.199285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:29.297295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:29.304484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca7b4e-4e29-4bd1-94d4-9895c2474eb2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:29.339055 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e8caf-36f2-4c51-9092-9226137fc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:29.339745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8caf-36f2-4c51-9092-9226137fc06e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:29.340092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8caf-36f2-4c51-9092-9226137fc06e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:29.340450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8caf-36f2-4c51-9092-9226137fc06e None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:29.341141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8caf-36f2-4c51-9092-9226137fc06e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:29.341508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8caf-36f2-4c51-9092-9226137fc06e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:29.342952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8caf-36f2-4c51-9092-9226137fc06e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:29.348095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 393/777] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Nov 2 07:23:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:29.353568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:29.454752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70707938-32ef-49b9-80cf-e1b25b2812df None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:29.490257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb166912-3775-4d25-9df6-f99d8972c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:29.490866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb166912-3775-4d25-9df6-f99d8972c76f None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:29.491146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb166912-3775-4d25-9df6-f99d8972c76f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:29.491417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb166912-3775-4d25-9df6-f99d8972c76f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:29.492092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb166912-3775-4d25-9df6-f99d8972c76f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:29.493718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb166912-3775-4d25-9df6-f99d8972c76f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:29.600458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 385/778] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:30.449209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b993c-a365-4545-a6bf-ebaa5c28f3f0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.449732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b993c-a365-4545-a6bf-ebaa5c28f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.449732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b993c-a365-4545-a6bf-ebaa5c28f3f0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.451178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 394/779] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:30.456104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd851148-4c64-4efa-9b7c-21bfc77877c1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.456507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd851148-4c64-4efa-9b7c-21bfc77877c1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.456702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd851148-4c64-4efa-9b7c-21bfc77877c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.476034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dd851148-4c64-4efa-9b7c-21bfc77877c1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:30.477268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dd851148-4c64-4efa-9b7c-21bfc77877c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:30.499642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:30.552956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 386/780] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:30.820328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b993c-a365-4545-a6bf-ebaa5c28f3f0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:30.922629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b993c-a365-4545-a6bf-ebaa5c28f3f0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:30.956149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22843a-2422-42d3-af8b-664c2fbf359b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:30.956804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22843a-2422-42d3-af8b-664c2fbf359b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:30.957080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22843a-2422-42d3-af8b-664c2fbf359b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:30.957346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22843a-2422-42d3-af8b-664c2fbf359b None admin] PATH_INFO: `/v3/services/image` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:30.957915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22843a-2422-42d3-af8b-664c2fbf359b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:30.959828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22843a-2422-42d3-af8b-664c2fbf359b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-4e22843a-2422-42d3-af8b-664c2fbf359b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:30.968509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:30.969480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 07:23:30.970326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:30.972778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 395/781] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:30.975504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd851148-4c64-4efa-9b7c-21bfc77877c1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.081042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd851148-4c64-4efa-9b7c-21bfc77877c1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.115081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.121081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.121081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.121081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.121081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] RBAC: Adding query filter params (name=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:31.121081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.121081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.133349 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 387/782] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:31.133516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2d1f-ab98-4116-aabf-2a300a95ac44 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.133516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2d1f-ab98-4116-aabf-2a300a95ac44 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.133516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2d1f-ab98-4116-aabf-2a300a95ac44 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.133516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 396/783] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:31.134993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.136476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c25ba-3249-4b6e-98be-c2fe3eefdd50 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.136765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c25ba-3249-4b6e-98be-c2fe3eefdd50 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.137037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c25ba-3249-4b6e-98be-c2fe3eefdd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.154157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.154388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c27c25ba-3249-4b6e-98be-c2fe3eefdd50 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:31.155784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c27c25ba-3249-4b6e-98be-c2fe3eefdd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:31.172933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.225603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 397/784] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:31.242651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907afc7-46fe-489f-95a0-91fb03d3de78 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.277313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.277910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.278187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.278456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.279073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] RBAC: Adding query filter params (type=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:31.279376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.281020 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.286019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 388/785] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:31.291568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c25ba-3249-4b6e-98be-c2fe3eefdd50 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.392024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c25ba-3249-4b6e-98be-c2fe3eefdd50 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.425835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.426432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.427242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.427515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.428189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.429570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.495155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.501069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 398/786] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:23:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:31.585530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.606806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8abe4-7ce9-4158-82d6-34eb5da1bb6d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.653819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b533e-65a0-44c3-a1ea-53dd12873276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.654395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b533e-65a0-44c3-a1ea-53dd12873276 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.654671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b533e-65a0-44c3-a1ea-53dd12873276 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.654940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b533e-65a0-44c3-a1ea-53dd12873276 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.667757 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b533e-65a0-44c3-a1ea-53dd12873276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f49b533e-65a0-44c3-a1ea-53dd12873276 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:31.672663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:31.673608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:31.674508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:31.677366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 389/787] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:31.681518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.693714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.754345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e3f86-09b0-44fb-a76b-d9014388cc0d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.754700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e3f86-09b0-44fb-a76b-d9014388cc0d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.754930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e3f86-09b0-44fb-a76b-d9014388cc0d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.756264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 390/788] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:23:31.761399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6959d7-f652-4745-a0bf-5e95f6ef0c57 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.761683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6959d7-f652-4745-a0bf-5e95f6ef0c57 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.762189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6959d7-f652-4745-a0bf-5e95f6ef0c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.781725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eb6959d7-f652-4745-a0bf-5e95f6ef0c57 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:31.782918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eb6959d7-f652-4745-a0bf-5e95f6ef0c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:31.790097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd45a5-0fd8-42a4-8217-1f46f35ca13a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.825439 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.826034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.826305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.826568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.827346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:31.827644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:31.829160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:31.843354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 399/789] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:31.844661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:31.853088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 391/790] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:31.923658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:31.953276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212ac2f-9b39-4f19-802e-1a976eb01669 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:31.987687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:31.988304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:31.988605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:31.988868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:31.998649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.000062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:32.014224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:32.015231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:32.016140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:32.016140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:32.016140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:32.016140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 400/791] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:32.022083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6959d7-f652-4745-a0bf-5e95f6ef0c57 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.088321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.124947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6959d7-f652-4745-a0bf-5e95f6ef0c57 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.125582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.164043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.164690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.165545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.165545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.165874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:32.166164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.167596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.184589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 392/792] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:32.185665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.235648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c45ec-8e5f-477b-b860-c7a8f573d917 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.260451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.274660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.275291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.275568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.275835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.276979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.278411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.280071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 401/793] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:23:32.286577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.297339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568fda3-58c7-412b-a787-0694587fff18 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.326842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.336889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.337734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.338386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.338658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.346311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.347767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:32.358812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:32.359830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:32.360909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 393/794] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:32.368576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.399442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a669c02-4841-4d5b-861d-c674dfcf5ef2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.436808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.437505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.437825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.438098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.438769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.440267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.477510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed827a4-aa5d-4483-9bb1-627cc5ab0f85 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.510333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.510920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.511200 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.511468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.512184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:32.512516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.513961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.530789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 402/795] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:32 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:23:32.538137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 394/796] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:32.539256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.590149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.651524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edb77e-ce65-43d1-a4f9-b00d8c66e7bf None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.690355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.690913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.691191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.691459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.703310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.704849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:32.719673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:32.720873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:32.721803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:32.721803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:32.721803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:32.721803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 403/797] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:32.726781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.775088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.830966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b334-ad30-445c-8f4f-f2f7ffb70c90 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:32.866132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:32.867019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:32.867503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:32.868066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:32.868903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:32.869381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:32.870928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:32.883448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 395/798] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:32.888707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:32.982997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:32.989945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394ab4d-5db4-454e-acd2-52b9e43b604c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:33.021558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:33.022195 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.022890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.023504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.030889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:33.032306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:33.043916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:33.045096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:33.046020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:33.046942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 404/799] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:33.050928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.157036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c9f3-f112-4d8c-8267-73221d1d8ec6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:33.160148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:33.191189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63460f2-e7b5-412a-a62b-1b29895a5761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:33.191796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63460f2-e7b5-412a-a62b-1b29895a5761 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.192071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63460f2-e7b5-412a-a62b-1b29895a5761 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.192336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63460f2-e7b5-412a-a62b-1b29895a5761 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.193064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63460f2-e7b5-412a-a62b-1b29895a5761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:33.193372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63460f2-e7b5-412a-a62b-1b29895a5761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:33.195308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63460f2-e7b5-412a-a62b-1b29895a5761 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:33.208000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 396/800] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:33.213694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:33.315015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bebd0-4518-4822-a199-2520fa4218d6 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:33.348310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d5630-43b3-4998-b7bc-1def560a260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:33.349548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5630-43b3-4998-b7bc-1def560a260d None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.349821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5630-43b3-4998-b7bc-1def560a260d None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.350084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5630-43b3-4998-b7bc-1def560a260d None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/e5e6e7eee9ea4be093bb283594f7651c/roles/1ef1703c4f474ae9aa4291d7dee6b894` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.352204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d5630-43b3-4998-b7bc-1def560a260d None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=e5e6e7eee9ea4be093bb283594f7651c, role_id=1ef1703c4f474ae9aa4291d7dee6b894)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:33.353670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d5630-43b3-4998-b7bc-1def560a260d None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:33.423578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 405/801] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:33 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/e5e6e7eee9ea4be093bb283594f7651c/roles/1ef1703c4f474ae9aa4291d7dee6b894 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:33.730160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1459-07e6-4f9a-a7ee-5b36a8cfa4c2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.730679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1459-07e6-4f9a-a7ee-5b36a8cfa4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.730679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1459-07e6-4f9a-a7ee-5b36a8cfa4c2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.732173 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 397/802] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:33.737139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087297-2320-4dd0-a946-57446170a8c2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:33.737524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087297-2320-4dd0-a946-57446170a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:33.737685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8087297-2320-4dd0-a946-57446170a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:33.756024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a8087297-2320-4dd0-a946-57446170a8c2 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:33.757224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a8087297-2320-4dd0-a946-57446170a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:33.766577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:33.828612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 406/803] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:34.103753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1459-07e6-4f9a-a7ee-5b36a8cfa4c2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.213808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1459-07e6-4f9a-a7ee-5b36a8cfa4c2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.248473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.249081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.249359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.249624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.250301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.251648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.308549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:34.308549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:34.308549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [parameters: {'id': 'd002d4d9f8d54e309fc5da66c05b4026', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:23:34.308549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:34.316078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 07:23:34.317054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 07:23:34.319598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 07:23:34.320613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 07:23:34.321516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 07:23:34.322303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'id': 'd002d4d9f8d54e309fc5da66c05b4026', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 07:23:34.324499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:34.326162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:34.328043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 398/804] 10.222.0.39 () {60 vars in 1137 bytes} [Wed Nov 2 07:23:34 2022] POST /identity/v3/domains => generated 190 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:34.329537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8087297-2320-4dd0-a946-57446170a8c2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.427540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8087297-2320-4dd0-a946-57446170a8c2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.461459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3505a41-32f7-4843-b37a-b20feeb19fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.462076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505a41-32f7-4843-b37a-b20feeb19fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.462347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505a41-32f7-4843-b37a-b20feeb19fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.462608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3505a41-32f7-4843-b37a-b20feeb19fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.472347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3505a41-32f7-4843-b37a-b20feeb19fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.474345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3505a41-32f7-4843-b37a-b20feeb19fd3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.476872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-d3505a41-32f7-4843-b37a-b20feeb19fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:34.489967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:34.493341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:34.494289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:34.494289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:34.494289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:34.494289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 407/805] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:34.497276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:34.525397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:34.595601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555ad17-370c-4658-8d91-052c1b0771bf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:34.635652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3bfaa-71e7-4d5e-a191-6ea935cfc6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:34.636292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3bfaa-71e7-4d5e-a191-6ea935cfc6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.636598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3bfaa-71e7-4d5e-a191-6ea935cfc6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.636867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3bfaa-71e7-4d5e-a191-6ea935cfc6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.637527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3bfaa-71e7-4d5e-a191-6ea935cfc6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:34.637825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3bfaa-71e7-4d5e-a191-6ea935cfc6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:34.639235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3bfaa-71e7-4d5e-a191-6ea935cfc6d0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:34.656527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 399/806] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:34.754113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a7b7c-0805-4441-bc8c-9b9e83dce691 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.754622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a7b7c-0805-4441-bc8c-9b9e83dce691 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.754622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a7b7c-0805-4441-bc8c-9b9e83dce691 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.756095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 408/807] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:34.761598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0db9c-1601-46e0-9839-03a49850c3b8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:34.762069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0db9c-1601-46e0-9839-03a49850c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:34.762144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0db9c-1601-46e0-9839-03a49850c3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:34.781494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b9d0db9c-1601-46e0-9839-03a49850c3b8 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:34.782495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b9d0db9c-1601-46e0-9839-03a49850c3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:34.864602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 400/808] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:35.132711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a7b7c-0805-4441-bc8c-9b9e83dce691 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:35.239798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a7b7c-0805-4441-bc8c-9b9e83dce691 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:35.272753 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb3949-e3d3-4b8b-9530-3ad82f5376d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:35.273361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3949-e3d3-4b8b-9530-3ad82f5376d0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.273634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3949-e3d3-4b8b-9530-3ad82f5376d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.273898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb3949-e3d3-4b8b-9530-3ad82f5376d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.274979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb3949-e3d3-4b8b-9530-3ad82f5376d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:35.276388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb3949-e3d3-4b8b-9530-3ad82f5376d0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:35.277961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 409/809] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:35.283863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0db9c-1601-46e0-9839-03a49850c3b8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:35.301351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:35.378788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0db9c-1601-46e0-9839-03a49850c3b8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:35.411801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b93045-5294-4c20-8d5b-c09a7829990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:35.412397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93045-5294-4c20-8d5b-c09a7829990d None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.412695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93045-5294-4c20-8d5b-c09a7829990d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.412962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b93045-5294-4c20-8d5b-c09a7829990d None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.413608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b93045-5294-4c20-8d5b-c09a7829990d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:35.415020 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b93045-5294-4c20-8d5b-c09a7829990d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:35.489454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 401/810] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:23:35 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:35.595383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193273-bfe3-449c-aa8e-2e517b7be3a8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.595663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193273-bfe3-449c-aa8e-2e517b7be3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.595932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91193273-bfe3-449c-aa8e-2e517b7be3a8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.597330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 410/811] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:35.603031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db1e2-2077-4650-b906-11c1b9052fc6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:35.603319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db1e2-2077-4650-b906-11c1b9052fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:35.603592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db1e2-2077-4650-b906-11c1b9052fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:35.624481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a98db1e2-2077-4650-b906-11c1b9052fc6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:35.625704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a98db1e2-2077-4650-b906-11c1b9052fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:35.695639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 402/812] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:35.968584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193273-bfe3-449c-aa8e-2e517b7be3a8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.030839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:36.068884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91193273-bfe3-449c-aa8e-2e517b7be3a8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.101911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.102521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.102879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.103148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.113148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:36.119961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:36.121300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:36.122231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 411/813] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Nov 2 07:23:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:36.125554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db1e2-2077-4650-b906-11c1b9052fc6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.128681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:36.223864 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db1e2-2077-4650-b906-11c1b9052fc6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.256936 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.257537 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.257810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.258074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.258729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:36.259023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.260371 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.268138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 403/814] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:36.274032 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.371581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375ee96-0d79-4934-a2fd-bb186ce51957 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.395669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:36.406796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.408313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.408313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.408313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.419086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.420533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:36.434892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:36.436036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:36.437419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:36.437419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:36.437419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:36.437419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 412/815] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:36.441637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.505229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:36.538998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24a24-891d-4c06-b148-90336a09ff22 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.570729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.571318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.571591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.571856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.572503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:36.572800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.574139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.585778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 404/816] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:36.591286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.687453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d5aba-2ac2-4d06-9abf-c84d214d0f7e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.720872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.721497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.721774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.722044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.730277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.731715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:23:36.742727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:36.743888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:36.744926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 413/817] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:36.749565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.846959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02202034-f21f-4b81-8f16-ac328589cf39 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:36.871347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:36.879213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:36.880312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:36.880612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:36.880880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:36.881597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:36.881899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:36.883320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:36.900395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 405/818] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:36.906182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:36.939587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.001060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb5a4-2ee0-4131-bd9a-175eacb6dbc0 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.033860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.034442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.034716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.034982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.099102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.100493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.135279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.200215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 414/819] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:37.205953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.300942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1e39b-6f36-40b6-b557-6468c2d83b63 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.334342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.334960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.335235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.335500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.345164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.346595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:23:37.361466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:37.362579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:23:37.364481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:23:37.364481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:23:37.364481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:37.364481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 406/820] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:37.368594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.464380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6a870-63ba-4480-939e-621c5e7ecb32 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.497860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830e4db-a61d-4f8f-a799-a519bedef841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.498454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830e4db-a61d-4f8f-a799-a519bedef841 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.498737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830e4db-a61d-4f8f-a799-a519bedef841 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.499002 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830e4db-a61d-4f8f-a799-a519bedef841 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.499631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830e4db-a61d-4f8f-a799-a519bedef841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:37.499930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830e4db-a61d-4f8f-a799-a519bedef841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.501309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830e4db-a61d-4f8f-a799-a519bedef841 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.503546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.512576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 415/821] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:37.523928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.668681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.670715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb35fe-bf6b-433c-af8d-c456426dd173 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.670998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb35fe-bf6b-433c-af8d-c456426dd173 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.671269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb35fe-bf6b-433c-af8d-c456426dd173 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.672627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 416/822] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:37.678044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700535f-8405-4d4e-bf7e-87b6c869debf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.678962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700535f-8405-4d4e-bf7e-87b6c869debf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.678962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700535f-8405-4d4e-bf7e-87b6c869debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.696614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4700535f-8405-4d4e-bf7e-87b6c869debf None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:37.697785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4700535f-8405-4d4e-bf7e-87b6c869debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:37.732194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602850a-2a8a-4c69-862c-bc331f5902db None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.762964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 417/823] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:37.764831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.765449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.765722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.765988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.772514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.773937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:23:37.784914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:37.791419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:37.792605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 407/824] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:37.793247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700535f-8405-4d4e-bf7e-87b6c869debf None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:37.888090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700535f-8405-4d4e-bf7e-87b6c869debf None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:37.915725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:37.925519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:37.926056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:37.926371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:37.926706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:37.927396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:37.927696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:37.929200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:37.940553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 418/825] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:37.946702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.031810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.039755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.045678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744615d-b669-4cc6-8de6-5db778324324 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.078951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.079539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.079809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.080069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.080811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] RBAC: Adding query filter params (role.id=1ef1703c4f474ae9aa4291d7dee6b894, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=e5e6e7eee9ea4be093bb283594f7651c) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:38.081131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.083044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.088754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 408/826] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:37 2022] GET /identity/v3/role_assignments?user.id=e5e6e7eee9ea4be093bb283594f7651c&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=1ef1703c4f474ae9aa4291d7dee6b894 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:38.138334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3840d1-11db-4713-a4ba-1adefeaf6f59 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.175426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.176110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.176361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.176654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.188324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:38.193726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:38.194729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:23:38.195859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 419/827] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:23:38.201015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.302164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c6f2c-6e26-45f0-bdff-52154b92a9c5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.336878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.337486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.337761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.338027 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.338678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:38.338980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.340320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.348643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 409/828] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:38.354531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.402498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.456116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b096-02ae-4b05-b3ae-13fb063ba3a6 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.490519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.491138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.491410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.491675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] PATH_INFO: `/v3/users/6d9c130572be4c8eb29e82dbac8f2c14` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.505687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9c130572be4c8eb29e82dbac8f2c14)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.507131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.508812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 420/829] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:38 2022] GET /identity/v3/users/6d9c130572be4c8eb29e82dbac8f2c14 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:38.514558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.540533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.619198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e63c44-13aa-410d-9595-731be990f5eb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.653564 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb6e1-6136-42ab-9608-ae4982dd63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.654182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb6e1-6136-42ab-9608-ae4982dd63d3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.654453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb6e1-6136-42ab-9608-ae4982dd63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.654717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb6e1-6136-42ab-9608-ae4982dd63d3 None admin] PATH_INFO: `/v3/projects/680f397efbf24a6b927c4610db415add` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.656061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb6e1-6136-42ab-9608-ae4982dd63d3 None admin] RBAC: Authorizing `identity:get_project(project_id=680f397efbf24a6b927c4610db415add)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.657548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb6e1-6136-42ab-9608-ae4982dd63d3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.659152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 410/830] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:23:38 2022] GET /identity/v3/projects/680f397efbf24a6b927c4610db415add => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:38.665125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:38.769904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b3c8d-6e17-420d-bd49-a6e7ce3ef6a8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:38.772140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:38.804148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2a6c3-1f02-4a9e-856f-7081ee42088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:38.804834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2a6c3-1f02-4a9e-856f-7081ee42088c None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:38.805113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2a6c3-1f02-4a9e-856f-7081ee42088c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:38.805414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2a6c3-1f02-4a9e-856f-7081ee42088c None admin] PATH_INFO: `/v3/projects/680f397efbf24a6b927c4610db415add/users/6d9c130572be4c8eb29e82dbac8f2c14/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:38.807287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2a6c3-1f02-4a9e-856f-7081ee42088c None admin] RBAC: Authorizing `identity:create_grant(project_id=680f397efbf24a6b927c4610db415add, user_id=6d9c130572be4c8eb29e82dbac8f2c14, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:38.808796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2a6c3-1f02-4a9e-856f-7081ee42088c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:38.888793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 421/831] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:38 2022] PUT /identity/v3/projects/680f397efbf24a6b927c4610db415add/users/6d9c130572be4c8eb29e82dbac8f2c14/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:40.995685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80bffe-ba79-4cd4-83d7-4abaa5bff7a7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:40.996244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80bffe-ba79-4cd4-83d7-4abaa5bff7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:40.996244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80bffe-ba79-4cd4-83d7-4abaa5bff7a7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:40.997591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 411/832] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:41.002726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ab60-4890-438c-b0a2-bd36473efbd5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.003087 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ab60-4890-438c-b0a2-bd36473efbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.003263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6ab60-4890-438c-b0a2-bd36473efbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.021461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-80e6ab60-4890-438c-b0a2-bd36473efbd5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:41.022617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-80e6ab60-4890-438c-b0a2-bd36473efbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:41.086726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 422/833] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:41.353243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80bffe-ba79-4cd4-83d7-4abaa5bff7a7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.441335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.451314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80bffe-ba79-4cd4-83d7-4abaa5bff7a7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.483691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.484287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.484585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.484849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.495072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:23:41.499722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:23:41.500914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:23:41.501925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 412/834] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:23:41.506781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ab60-4890-438c-b0a2-bd36473efbd5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.595207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.601840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6ab60-4890-438c-b0a2-bd36473efbd5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.633921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.634449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.634726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.634993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.635641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:41.635939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.637331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.645486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 423/835] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:41.651264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.745656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0e202-d5b2-49cf-a37a-fcd10347d732 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.777255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.777851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.778125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.778390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] PATH_INFO: `/v3/users/6d9c130572be4c8eb29e82dbac8f2c14` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.779514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] RBAC: Authorizing `identity:get_user(user_id=6d9c130572be4c8eb29e82dbac8f2c14)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.781202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:41.782727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 413/836] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/users/6d9c130572be4c8eb29e82dbac8f2c14 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:41.788832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:41.884405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379018-0585-446f-9192-1b6f6fe47f8c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:41.917249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:41.917838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:41.918110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:41.918376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:41.942802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:41.983792 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:41.985259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.078484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 424/837] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:42.085035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.103460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:42.183203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53446ad2-991f-4855-8a27-b26eab53561a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.216166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081e2dc-9b50-4764-88be-ccb8d958340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.216806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e2dc-9b50-4764-88be-ccb8d958340d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.217084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e2dc-9b50-4764-88be-ccb8d958340d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.217357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081e2dc-9b50-4764-88be-ccb8d958340d None admin] PATH_INFO: `/v3/projects/680f397efbf24a6b927c4610db415add` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.218459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e2dc-9b50-4764-88be-ccb8d958340d None admin] RBAC: Authorizing `identity:get_project(project_id=680f397efbf24a6b927c4610db415add)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.219875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081e2dc-9b50-4764-88be-ccb8d958340d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.221516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 414/838] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:23:42 2022] GET /identity/v3/projects/680f397efbf24a6b927c4610db415add => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:42.227539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:42.282143 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:42.324616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046bc8c-8aac-4413-94ca-17a09e564b79 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:42.356698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90bdf-dd3d-4453-aa84-e7af41337fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:42.357275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90bdf-dd3d-4453-aa84-e7af41337fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:42.357546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90bdf-dd3d-4453-aa84-e7af41337fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:42.357809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90bdf-dd3d-4453-aa84-e7af41337fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:42.358506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90bdf-dd3d-4453-aa84-e7af41337fd5 None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=680f397efbf24a6b927c4610db415add, user.id=6d9c130572be4c8eb29e82dbac8f2c14) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:42.358803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90bdf-dd3d-4453-aa84-e7af41337fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:42.360201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b90bdf-dd3d-4453-aa84-e7af41337fd5 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:42.366253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 425/839] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:42 2022] GET /identity/v3/role_assignments?user.id=6d9c130572be4c8eb29e82dbac8f2c14&scope.project.id=680f397efbf24a6b927c4610db415add&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:44.505889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c4db-fdcf-4039-afbe-f0b331991b88 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.506401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c4db-fdcf-4039-afbe-f0b331991b88 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.506401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c4db-fdcf-4039-afbe-f0b331991b88 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.507689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 415/840] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:44.513044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009c2e-b432-4cb8-af59-ccf1c42361bd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.513416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009c2e-b432-4cb8-af59-ccf1c42361bd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.513594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c009c2e-b432-4cb8-af59-ccf1c42361bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.531924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8c009c2e-b432-4cb8-af59-ccf1c42361bd None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:44.533123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8c009c2e-b432-4cb8-af59-ccf1c42361bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:44.597046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 426/841] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:44.868292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c4db-fdcf-4039-afbe-f0b331991b88 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:44.950021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:44.964541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c4db-fdcf-4039-afbe-f0b331991b88 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:44.997207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984f4d2-542e-4e0d-af0c-94d8329ef3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:44.997800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984f4d2-542e-4e0d-af0c-94d8329ef3df None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:44.998071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984f4d2-542e-4e0d-af0c-94d8329ef3df None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:44.998333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984f4d2-542e-4e0d-af0c-94d8329ef3df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:44.999402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984f4d2-542e-4e0d-af0c-94d8329ef3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.000839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984f4d2-542e-4e0d-af0c-94d8329ef3df None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.002342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 416/842] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:45.008015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009c2e-b432-4cb8-af59-ccf1c42361bd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:45.055847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:45.103576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c009c2e-b432-4cb8-af59-ccf1c42361bd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:45.137235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc7874-c30b-45da-8d9a-5a65336ce832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:45.137834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7874-c30b-45da-8d9a-5a65336ce832 None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:45.138112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7874-c30b-45da-8d9a-5a65336ce832 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:45.138377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc7874-c30b-45da-8d9a-5a65336ce832 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:45.139023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7874-c30b-45da-8d9a-5a65336ce832 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:45.140452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc7874-c30b-45da-8d9a-5a65336ce832 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:45.236307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 427/843] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:23:45 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:23:47.386110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1ae34-8175-4736-87f3-2d36f79dad85 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.386633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1ae34-8175-4736-87f3-2d36f79dad85 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.386633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1ae34-8175-4736-87f3-2d36f79dad85 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.387918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 417/844] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:47.393252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c878e-8004-43ab-ac34-a849392bed88 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.393646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c878e-8004-43ab-ac34-a849392bed88 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.393790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c878e-8004-43ab-ac34-a849392bed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.412133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-600c878e-8004-43ab-ac34-a849392bed88 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:47.413310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-600c878e-8004-43ab-ac34-a849392bed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:47.476917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 428/845] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:47.745282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1ae34-8175-4736-87f3-2d36f79dad85 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:47.841122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1ae34-8175-4736-87f3-2d36f79dad85 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:47.872899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:47.873496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:47.873766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:47.874025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] PATH_INFO: `/v3/roles/9633c4426fd245b7ad054ad7ca81ce1c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:47.875372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] RBAC: Authorizing `identity:get_role(role_id=9633c4426fd245b7ad054ad7ca81ce1c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:47.876742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:47.878013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 418/846] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:47 2022] GET /identity/v3/roles/9633c4426fd245b7ad054ad7ca81ce1c => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:47.884196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c878e-8004-43ab-ac34-a849392bed88 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:47.917279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:47.983989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c878e-8004-43ab-ac34-a849392bed88 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:48.018136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:48.018691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:48.018969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:48.019239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] PATH_INFO: `/v3/users/fd804704af6d4227bc6a130d838e3ea8` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:48.032349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] RBAC: Authorizing `identity:get_user(user_id=fd804704af6d4227bc6a130d838e3ea8)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:48.033809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:48.035929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 429/847] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:47 2022] GET /identity/v3/users/fd804704af6d4227bc6a130d838e3ea8 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:48.041767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:48.066143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:48.142418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20e93c-668e-4775-8317-eb2009724bb6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:48.176711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a84b84-ac73-470a-af75-ae4180c2b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:48.177324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a84b84-ac73-470a-af75-ae4180c2b668 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:48.177601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a84b84-ac73-470a-af75-ae4180c2b668 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:48.177875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a84b84-ac73-470a-af75-ae4180c2b668 None admin] PATH_INFO: `/v3/projects/680f397efbf24a6b927c4610db415add` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:48.179018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a84b84-ac73-470a-af75-ae4180c2b668 None admin] RBAC: Authorizing `identity:get_project(project_id=680f397efbf24a6b927c4610db415add)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:48.180460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a84b84-ac73-470a-af75-ae4180c2b668 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:48.182084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 419/848] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:23:48 2022] GET /identity/v3/projects/680f397efbf24a6b927c4610db415add => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:48.188138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:48.326416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:48.333219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51bec-72f3-43cf-b553-0f616a24ff68 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:48.366586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b3710-a7b5-46e2-9cb5-3235c17fd4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:48.367218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b3710-a7b5-46e2-9cb5-3235c17fd4b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:48.367493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b3710-a7b5-46e2-9cb5-3235c17fd4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:48.367759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b3710-a7b5-46e2-9cb5-3235c17fd4b3 None admin] PATH_INFO: `/v3/projects/680f397efbf24a6b927c4610db415add/users/fd804704af6d4227bc6a130d838e3ea8/roles/9633c4426fd245b7ad054ad7ca81ce1c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:48.369868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b3710-a7b5-46e2-9cb5-3235c17fd4b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=680f397efbf24a6b927c4610db415add, user_id=fd804704af6d4227bc6a130d838e3ea8, role_id=9633c4426fd245b7ad054ad7ca81ce1c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:48.371280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b3710-a7b5-46e2-9cb5-3235c17fd4b3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:48.436246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 430/849] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:23:48 2022] PUT /identity/v3/projects/680f397efbf24a6b927c4610db415add/users/fd804704af6d4227bc6a130d838e3ea8/roles/9633c4426fd245b7ad054ad7ca81ce1c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:23:50.546821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028edfd-bdcb-4239-9cd6-b824cf3c90f2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.547322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028edfd-bdcb-4239-9cd6-b824cf3c90f2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.547322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028edfd-bdcb-4239-9cd6-b824cf3c90f2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.548647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 420/850] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:50.554439 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b20eb-4a94-49b6-b230-eb8fd49dfb01 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:50.554865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b20eb-4a94-49b6-b230-eb8fd49dfb01 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:50.554974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b20eb-4a94-49b6-b230-eb8fd49dfb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:50.572716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-172b20eb-4a94-49b6-b230-eb8fd49dfb01 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:50.573878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-172b20eb-4a94-49b6-b230-eb8fd49dfb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:50.637894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 431/851] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:50.906386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028edfd-bdcb-4239-9cd6-b824cf3c90f2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:50.992648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.002306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028edfd-bdcb-4239-9cd6-b824cf3c90f2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.034535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.035155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.035422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.035681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] PATH_INFO: `/v3/roles/9633c4426fd245b7ad054ad7ca81ce1c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.037044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] RBAC: Authorizing `identity:get_role(role_id=9633c4426fd245b7ad054ad7ca81ce1c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.038395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.039873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 421/852] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:50 2022] GET /identity/v3/roles/9633c4426fd245b7ad054ad7ca81ce1c => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:51.045521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b20eb-4a94-49b6-b230-eb8fd49dfb01 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.127027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.142727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b20eb-4a94-49b6-b230-eb8fd49dfb01 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.175891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.176462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.176744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.177013 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] PATH_INFO: `/v3/users/fd804704af6d4227bc6a130d838e3ea8` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.178104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] RBAC: Authorizing `identity:get_user(user_id=fd804704af6d4227bc6a130d838e3ea8)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.179518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.181114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 432/853] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/users/fd804704af6d4227bc6a130d838e3ea8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:51.186987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.282092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8292c-dbeb-44cd-b542-b88e85cfa5f0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.314130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.314713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.314987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.315254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.340796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.378682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.381450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.473037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 422/854] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:23:51.478912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.574898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede4539-fad4-4b90-b187-2f0d9119d43a None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.607158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f74ad-1d98-4433-9bbc-f11f92e1f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.607760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f74ad-1d98-4433-9bbc-f11f92e1f803 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.608036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f74ad-1d98-4433-9bbc-f11f92e1f803 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.608304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f74ad-1d98-4433-9bbc-f11f92e1f803 None admin] PATH_INFO: `/v3/projects/680f397efbf24a6b927c4610db415add` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.609426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f74ad-1d98-4433-9bbc-f11f92e1f803 None admin] RBAC: Authorizing `identity:get_project(project_id=680f397efbf24a6b927c4610db415add)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.610842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f74ad-1d98-4433-9bbc-f11f92e1f803 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.612424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 433/855] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/projects/680f397efbf24a6b927c4610db415add => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:51.618974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:51.673942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:51.713970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0e5ed-a498-4907-84c7-7a5ac148ca84 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:51.746823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef7cc0-67b1-445d-ab1d-c30e3d3247ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:51.747354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7cc0-67b1-445d-ab1d-c30e3d3247ad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:51.747631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7cc0-67b1-445d-ab1d-c30e3d3247ad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:51.747901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7cc0-67b1-445d-ab1d-c30e3d3247ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:51.748642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef7cc0-67b1-445d-ab1d-c30e3d3247ad None admin] RBAC: Adding query filter params (role.id=9633c4426fd245b7ad054ad7ca81ce1c, scope.project.id=680f397efbf24a6b927c4610db415add, user.id=fd804704af6d4227bc6a130d838e3ea8) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:23:51.748950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef7cc0-67b1-445d-ab1d-c30e3d3247ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:51.750370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef7cc0-67b1-445d-ab1d-c30e3d3247ad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:51.755900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 423/856] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:23:51 2022] GET /identity/v3/role_assignments?user.id=fd804704af6d4227bc6a130d838e3ea8&scope.project.id=680f397efbf24a6b927c4610db415add&role.id=9633c4426fd245b7ad054ad7ca81ce1c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:53.871114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43415352-9681-4bb3-9e63-c2a65cae0017 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:53.871631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43415352-9681-4bb3-9e63-c2a65cae0017 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:53.871719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43415352-9681-4bb3-9e63-c2a65cae0017 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:53.873029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 434/857] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:53.878176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f2871-3cca-4932-b3ca-cf88971df828 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:53.878612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f2871-3cca-4932-b3ca-cf88971df828 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:53.879298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f2871-3cca-4932-b3ca-cf88971df828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:53.897096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e55f2871-3cca-4932-b3ca-cf88971df828 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:53.898279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e55f2871-3cca-4932-b3ca-cf88971df828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:53.961672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 424/858] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:23:54.236258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43415352-9681-4bb3-9e63-c2a65cae0017 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.257935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:54.335686 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43415352-9681-4bb3-9e63-c2a65cae0017 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.368208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a374e-5137-4ef1-9acf-230a94de5fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.368845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a374e-5137-4ef1-9acf-230a94de5fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.369121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a374e-5137-4ef1-9acf-230a94de5fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.369386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a374e-5137-4ef1-9acf-230a94de5fb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.370469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a374e-5137-4ef1-9acf-230a94de5fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:54.371876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a374e-5137-4ef1-9acf-230a94de5fb4 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:54.373483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 435/859] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:54.379197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f2871-3cca-4932-b3ca-cf88971df828 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:54.430977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:54.475570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f2871-3cca-4932-b3ca-cf88971df828 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:54.508255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4311f0-5289-421a-acb8-9460bcf0451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:54.508870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4311f0-5289-421a-acb8-9460bcf0451e None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:54.509141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4311f0-5289-421a-acb8-9460bcf0451e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:54.509405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4311f0-5289-421a-acb8-9460bcf0451e None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:54.510040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4311f0-5289-421a-acb8-9460bcf0451e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:54.511479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4311f0-5289-421a-acb8-9460bcf0451e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:54.585514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 425/860] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:23:54 2022] POST /identity/v3/projects => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:56.727316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73491d-9149-4fc4-9b9e-70c348cf93a6 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:56.727869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73491d-9149-4fc4-9b9e-70c348cf93a6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:56.727869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73491d-9149-4fc4-9b9e-70c348cf93a6 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:56.729233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 436/861] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:56.734478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2b9a1-f84e-4002-8d61-5fe18bf371ee None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:56.734893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2b9a1-f84e-4002-8d61-5fe18bf371ee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:56.734998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2b9a1-f84e-4002-8d61-5fe18bf371ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:56.753154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9ca2b9a1-f84e-4002-8d61-5fe18bf371ee None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:56.754849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9ca2b9a1-f84e-4002-8d61-5fe18bf371ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:56.817747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 426/862] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:57.090574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73491d-9149-4fc4-9b9e-70c348cf93a6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:57.178273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:57.190551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73491d-9149-4fc4-9b9e-70c348cf93a6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:57.223900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6a110-65e9-4f07-a3e1-52d05825027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:57.224542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a110-65e9-4f07-a3e1-52d05825027a None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.224821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a110-65e9-4f07-a3e1-52d05825027a None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.225090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a110-65e9-4f07-a3e1-52d05825027a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.226184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6a110-65e9-4f07-a3e1-52d05825027a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:57.227604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6a110-65e9-4f07-a3e1-52d05825027a None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:57.229199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 437/863] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:23:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:23:57.234922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2b9a1-f84e-4002-8d61-5fe18bf371ee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:23:57.266910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:23:57.329517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2b9a1-f84e-4002-8d61-5fe18bf371ee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:23:57.362510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4527bc-1725-4759-8dc0-f5f116c2a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:23:57.363060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4527bc-1725-4759-8dc0-f5f116c2a0e1 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:57.363330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4527bc-1725-4759-8dc0-f5f116c2a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:57.363594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4527bc-1725-4759-8dc0-f5f116c2a0e1 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:57.364234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4527bc-1725-4759-8dc0-f5f116c2a0e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:23:57.365663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4527bc-1725-4759-8dc0-f5f116c2a0e1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:23:57.469777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 427/864] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:23:57 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:23:59.610964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79afa-dd43-4cdb-a356-256f69cae68e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:59.611488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79afa-dd43-4cdb-a356-256f69cae68e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:59.611488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79afa-dd43-4cdb-a356-256f69cae68e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:59.612873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 438/865] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:23:59.618207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d11c3e-f6b8-44f5-8a45-676c9b6aa603 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:23:59.618600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d11c3e-f6b8-44f5-8a45-676c9b6aa603 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:23:59.618740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d11c3e-f6b8-44f5-8a45-676c9b6aa603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:23:59.636191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e7d11c3e-f6b8-44f5-8a45-676c9b6aa603 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:23:59.637376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e7d11c3e-f6b8-44f5-8a45-676c9b6aa603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:23:59.701163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 428/866] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:23:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:23:59.969231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79afa-dd43-4cdb-a356-256f69cae68e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:00.070573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79afa-dd43-4cdb-a356-256f69cae68e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:00.102881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:00.103486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:00.103758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:00.104022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:00.113562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:00.118324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:00.119250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:24:00.120113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 439/867] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:00.125552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d11c3e-f6b8-44f5-8a45-676c9b6aa603 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:00.146976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:00.222508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d11c3e-f6b8-44f5-8a45-676c9b6aa603 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:00.256525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:00.257112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:00.257388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:00.257688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:00.258340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:00.258639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:00.259990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:00.268009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 429/868] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:00.274474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:00.293238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:00.373928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed902e-878f-459c-9bed-1b713bbd6b31 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:00.408129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:00.408767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:00.409044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:00.409315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] PATH_INFO: `/v3/users/8ed3ea0c7b934404b09ac39b4af1aa87` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:00.422113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=8ed3ea0c7b934404b09ac39b4af1aa87)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:00.423539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:00.425741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 440/869] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:00 2022] GET /identity/v3/users/8ed3ea0c7b934404b09ac39b4af1aa87 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:00.431565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:00.509950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:00.526672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d9531-f520-44eb-8de9-a81916a99295 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:00.559102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e282bb7-dbdf-49b8-81f0-336751babc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:00.559706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e282bb7-dbdf-49b8-81f0-336751babc74 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:00.559979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e282bb7-dbdf-49b8-81f0-336751babc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:00.560242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e282bb7-dbdf-49b8-81f0-336751babc74 None admin] PATH_INFO: `/v3/projects/a6710502a4a04a1dbbabe83424c37cbb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:00.561359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e282bb7-dbdf-49b8-81f0-336751babc74 None admin] RBAC: Authorizing `identity:get_project(project_id=a6710502a4a04a1dbbabe83424c37cbb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:00.562759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e282bb7-dbdf-49b8-81f0-336751babc74 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:00.564341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 430/870] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:00 2022] GET /identity/v3/projects/a6710502a4a04a1dbbabe83424c37cbb => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:00.570739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:00.643608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:00.668130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794417c-d6ee-4f5a-8792-abe149a9c4d7 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:00.701902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341db0c-2fd7-4a42-afb0-521826eb8dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:00.702536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341db0c-2fd7-4a42-afb0-521826eb8dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:00.702815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341db0c-2fd7-4a42-afb0-521826eb8dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:00.703085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341db0c-2fd7-4a42-afb0-521826eb8dc2 None admin] PATH_INFO: `/v3/projects/a6710502a4a04a1dbbabe83424c37cbb/users/8ed3ea0c7b934404b09ac39b4af1aa87/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:00.704971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341db0c-2fd7-4a42-afb0-521826eb8dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6710502a4a04a1dbbabe83424c37cbb, user_id=8ed3ea0c7b934404b09ac39b4af1aa87, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:00.706418 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341db0c-2fd7-4a42-afb0-521826eb8dc2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:00.781539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 441/871] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:00 2022] PUT /identity/v3/projects/a6710502a4a04a1dbbabe83424c37cbb/users/8ed3ea0c7b934404b09ac39b4af1aa87/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:02.882935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af4c6-b122-459e-925c-ed0b628c6b39 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:02.883456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af4c6-b122-459e-925c-ed0b628c6b39 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:02.883456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af4c6-b122-459e-925c-ed0b628c6b39 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:02.884845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 431/872] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:02.890006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010635-fd46-460e-996f-7812e4093737 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:02.890412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010635-fd46-460e-996f-7812e4093737 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:02.890551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010635-fd46-460e-996f-7812e4093737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:02.908918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3e010635-fd46-460e-996f-7812e4093737 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:02.910067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3e010635-fd46-460e-996f-7812e4093737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:03.087937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 442/873] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:03.355415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47af4c6-b122-459e-925c-ed0b628c6b39 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:03.452885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47af4c6-b122-459e-925c-ed0b628c6b39 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:03.485211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:03.485808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:03.486083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:03.486348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:03.496369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:03.501067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:03.502181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:24:03.503039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 432/874] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:03.508000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e010635-fd46-460e-996f-7812e4093737 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:03.566603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:03.603300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e010635-fd46-460e-996f-7812e4093737 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:03.635167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:03.635690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:03.635962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:03.636224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:03.636898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:03.637196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:03.638527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:03.646795 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 443/875] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:03.652546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:03.665457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:03.747754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b46358-56a9-4e95-8290-939d46c21a71 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:03.779761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:03.780633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:03.780906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:03.781169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] PATH_INFO: `/v3/users/8ed3ea0c7b934404b09ac39b4af1aa87` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:03.782259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] RBAC: Authorizing `identity:get_user(user_id=8ed3ea0c7b934404b09ac39b4af1aa87)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:03.783661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:03.785233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 433/876] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:03 2022] GET /identity/v3/users/8ed3ea0c7b934404b09ac39b4af1aa87 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:03.790785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:03.885103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a415d-9cad-4f9b-992b-4404ebddf737 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:03.909499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:03.917506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:03.920927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:03.920927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:03.920927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:03.982574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:03.983982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:04.080263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 444/877] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:24:04.086218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:04.162118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:04.182368 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fcd1b-ffd5-4557-bfe4-9b5616a4736f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:04.214811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a83b2c-7b36-4a61-90b9-71de1712f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:04.215420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a83b2c-7b36-4a61-90b9-71de1712f8dd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:04.215699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a83b2c-7b36-4a61-90b9-71de1712f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:04.215969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a83b2c-7b36-4a61-90b9-71de1712f8dd None admin] PATH_INFO: `/v3/projects/a6710502a4a04a1dbbabe83424c37cbb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:04.217081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a83b2c-7b36-4a61-90b9-71de1712f8dd None admin] RBAC: Authorizing `identity:get_project(project_id=a6710502a4a04a1dbbabe83424c37cbb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:04.218506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a83b2c-7b36-4a61-90b9-71de1712f8dd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:04.220103 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 434/878] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:04 2022] GET /identity/v3/projects/a6710502a4a04a1dbbabe83424c37cbb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:04.226214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:04.251996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:04.321304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71bd19-7e5e-40fe-b033-536be5897a55 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:04.352947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f844f-1cbe-41be-98c1-e5ae2e964a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:04.353524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f844f-1cbe-41be-98c1-e5ae2e964a18 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:04.353796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f844f-1cbe-41be-98c1-e5ae2e964a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:04.354059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f844f-1cbe-41be-98c1-e5ae2e964a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:04.354761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f844f-1cbe-41be-98c1-e5ae2e964a18 None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=a6710502a4a04a1dbbabe83424c37cbb, user.id=8ed3ea0c7b934404b09ac39b4af1aa87) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:04.355058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f844f-1cbe-41be-98c1-e5ae2e964a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:04.356469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f844f-1cbe-41be-98c1-e5ae2e964a18 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:04.361933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 445/879] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:04 2022] GET /identity/v3/role_assignments?user.id=8ed3ea0c7b934404b09ac39b4af1aa87&scope.project.id=a6710502a4a04a1dbbabe83424c37cbb&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:06.481405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7163e-9d20-4c9b-b83b-4269eda5e5ca None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:06.481950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7163e-9d20-4c9b-b83b-4269eda5e5ca None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:06.481950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7163e-9d20-4c9b-b83b-4269eda5e5ca None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:06.483180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 435/880] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:06.488281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1194a-0b54-4486-8965-62914629a97b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:06.488698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1194a-0b54-4486-8965-62914629a97b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:06.488851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1194a-0b54-4486-8965-62914629a97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:06.506232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4ec1194a-0b54-4486-8965-62914629a97b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:06.507374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4ec1194a-0b54-4486-8965-62914629a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:06.571097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 446/881] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:06.834825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7163e-9d20-4c9b-b83b-4269eda5e5ca None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:06.931008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7163e-9d20-4c9b-b83b-4269eda5e5ca None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:06.963048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbce7ef-351c-43a1-b0b2-7c2bf24e1d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:06.963622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce7ef-351c-43a1-b0b2-7c2bf24e1d82 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:06.963890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce7ef-351c-43a1-b0b2-7c2bf24e1d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:06.964151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbce7ef-351c-43a1-b0b2-7c2bf24e1d82 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:06.964948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbce7ef-351c-43a1-b0b2-7c2bf24e1d82 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:06.966285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbce7ef-351c-43a1-b0b2-7c2bf24e1d82 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:07.043404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 436/882] 10.222.0.39 () {60 vars in 1138 bytes} [Wed Nov 2 07:24:06 2022] POST /identity/v3/domains => generated 267 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:24:09.223345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74358c3-773a-41c5-9df6-6d463df4bb11 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:09.223885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74358c3-773a-41c5-9df6-6d463df4bb11 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:09.223885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74358c3-773a-41c5-9df6-6d463df4bb11 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:09.225260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 447/883] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:09.230458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6366c-067a-4f20-9b6b-433eed27836a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:09.230854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6366c-067a-4f20-9b6b-433eed27836a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:09.230992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6366c-067a-4f20-9b6b-433eed27836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:09.244087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:09.249497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a7e6366c-067a-4f20-9b6b-433eed27836a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:09.250652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a7e6366c-067a-4f20-9b6b-433eed27836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:09.314399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 437/884] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:09.586097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74358c3-773a-41c5-9df6-6d463df4bb11 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:09.607021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:09.683682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74358c3-773a-41c5-9df6-6d463df4bb11 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:09.715921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d1d2a-cb30-49bc-aaf4-f867bb3ebaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:09.716554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d1d2a-cb30-49bc-aaf4-f867bb3ebaaf None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:09.716829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d1d2a-cb30-49bc-aaf4-f867bb3ebaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:09.717093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d1d2a-cb30-49bc-aaf4-f867bb3ebaaf None admin] PATH_INFO: `/v3/domains/d3ae936c37994847bc305023642eb235` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:09.727453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d1d2a-cb30-49bc-aaf4-f867bb3ebaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=d3ae936c37994847bc305023642eb235)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:09.728904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d1d2a-cb30-49bc-aaf4-f867bb3ebaaf None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:09.730433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 448/885] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Nov 2 07:24:09 2022] GET /identity/v3/domains/d3ae936c37994847bc305023642eb235 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:09.736274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6366c-067a-4f20-9b6b-433eed27836a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:09.830188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6366c-067a-4f20-9b6b-433eed27836a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:09.863456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1650c60-32c8-4d42-adc6-7674befca2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:09.863969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1650c60-32c8-4d42-adc6-7674befca2f0 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:09.864239 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1650c60-32c8-4d42-adc6-7674befca2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:09.864531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1650c60-32c8-4d42-adc6-7674befca2f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:09.865161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1650c60-32c8-4d42-adc6-7674befca2f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:09.866556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1650c60-32c8-4d42-adc6-7674befca2f0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:09.871607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:09.977036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 438/886] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:24:09 2022] POST /identity/v3/projects => generated 361 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:12.134534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781dc2-785d-4a71-bb32-b389c252145c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.134998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781dc2-785d-4a71-bb32-b389c252145c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.135096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c781dc2-785d-4a71-bb32-b389c252145c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.136398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 449/887] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:12.141556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c699-945e-4942-8e45-5c60684d069a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.141929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c699-945e-4942-8e45-5c60684d069a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.142080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c699-945e-4942-8e45-5c60684d069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.160300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1778c699-945e-4942-8e45-5c60684d069a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:12.161470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1778c699-945e-4942-8e45-5c60684d069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:12.224016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 439/888] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 07:24:12.492321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781dc2-785d-4a71-bb32-b389c252145c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:12.571206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:12.589844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c781dc2-785d-4a71-bb32-b389c252145c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:12.621793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96de8aa-75dd-47c6-883a-d15e7d2d2ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:12.622390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de8aa-75dd-47c6-883a-d15e7d2d2ccc None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.622659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de8aa-75dd-47c6-883a-d15e7d2d2ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.622919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96de8aa-75dd-47c6-883a-d15e7d2d2ccc None admin] PATH_INFO: `/v3/domains/d3ae936c37994847bc305023642eb235` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.623995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96de8aa-75dd-47c6-883a-d15e7d2d2ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=d3ae936c37994847bc305023642eb235)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:12.625435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96de8aa-75dd-47c6-883a-d15e7d2d2ccc None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:12.626949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 450/889] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Nov 2 07:24:12 2022] GET /identity/v3/domains/d3ae936c37994847bc305023642eb235 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:12.633142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c699-945e-4942-8e45-5c60684d069a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:12.726469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c699-945e-4942-8e45-5c60684d069a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:12.743488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:12.759313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da137e7-786b-40cf-ab4a-d67b30828af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:12.759903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da137e7-786b-40cf-ab4a-d67b30828af2 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:12.760178 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da137e7-786b-40cf-ab4a-d67b30828af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:12.760465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da137e7-786b-40cf-ab4a-d67b30828af2 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:12.761106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da137e7-786b-40cf-ab4a-d67b30828af2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:12.762526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da137e7-786b-40cf-ab4a-d67b30828af2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:12.864114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 440/890] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:24:12 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:24:15.012201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a0667-a3a1-477d-91f3-18673f94a4af None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.012777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a0667-a3a1-477d-91f3-18673f94a4af None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.012777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a0667-a3a1-477d-91f3-18673f94a4af None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.014095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 451/891] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:15.019705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d922-04f9-4422-93f5-5a3d78979ca3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.020108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d922-04f9-4422-93f5-5a3d78979ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.020246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4d922-04f9-4422-93f5-5a3d78979ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.038288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d2e4d922-04f9-4422-93f5-5a3d78979ca3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:15.039444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d2e4d922-04f9-4422-93f5-5a3d78979ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:15.104524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 441/892] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:15.375777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a0667-a3a1-477d-91f3-18673f94a4af None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:15.473533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a0667-a3a1-477d-91f3-18673f94a4af None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:15.506378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:15.506982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.507257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.507523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.517255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:15.521981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:15.523145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:24:15.524069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 452/893] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:15.528807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d922-04f9-4422-93f5-5a3d78979ca3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:15.622362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4d922-04f9-4422-93f5-5a3d78979ca3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:15.624595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:15.654374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:15.655174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.655445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.655709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.656354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:15.656680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:15.658039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:15.666401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 442/894] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:15.672156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:15.683620 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:15.768808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17330b-55f3-4b53-b7fc-32078863d9c8 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:15.801831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:15.802425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.802695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.802956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] PATH_INFO: `/v3/users/be49f6fedc4f450d906879aa14cda65d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.815585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] RBAC: Authorizing `identity:get_user(user_id=be49f6fedc4f450d906879aa14cda65d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:15.817025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:15.818556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 453/895] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/users/be49f6fedc4f450d906879aa14cda65d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:15.824242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:15.919753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5a442-32b3-42b9-aa4b-87015ed0d52a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:15.952369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac32950-bfb1-4bb1-8daa-43a9af16d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:15.953010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32950-bfb1-4bb1-8daa-43a9af16d610 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:15.953285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32950-bfb1-4bb1-8daa-43a9af16d610 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:15.953554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32950-bfb1-4bb1-8daa-43a9af16d610 None admin] PATH_INFO: `/v3/projects/ca50c83f544b412c8ffaee8d4c05f88c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:15.954658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac32950-bfb1-4bb1-8daa-43a9af16d610 None admin] RBAC: Authorizing `identity:get_project(project_id=ca50c83f544b412c8ffaee8d4c05f88c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:15.956124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac32950-bfb1-4bb1-8daa-43a9af16d610 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:15.957772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 443/896] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:15 2022] GET /identity/v3/projects/ca50c83f544b412c8ffaee8d4c05f88c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:15.963664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:16.027827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:16.065102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c9666-1f39-48b2-8c41-4ff8ac3baf7e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:16.099483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4511e00-871f-4b08-ac64-f3e725f9a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:16.100397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4511e00-871f-4b08-ac64-f3e725f9a8d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:16.101343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4511e00-871f-4b08-ac64-f3e725f9a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:16.101794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4511e00-871f-4b08-ac64-f3e725f9a8d7 None admin] PATH_INFO: `/v3/projects/ca50c83f544b412c8ffaee8d4c05f88c/users/be49f6fedc4f450d906879aa14cda65d/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:16.104497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4511e00-871f-4b08-ac64-f3e725f9a8d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca50c83f544b412c8ffaee8d4c05f88c, user_id=be49f6fedc4f450d906879aa14cda65d, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:16.106028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4511e00-871f-4b08-ac64-f3e725f9a8d7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:16.167111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 454/897] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:24:15 2022] PUT /identity/v3/projects/ca50c83f544b412c8ffaee8d4c05f88c/users/be49f6fedc4f450d906879aa14cda65d/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:24:18.283744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91adf5-e904-4a27-8941-55f3cbf84030 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:18.284300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91adf5-e904-4a27-8941-55f3cbf84030 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:18.284300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91adf5-e904-4a27-8941-55f3cbf84030 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:18.285644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 444/898] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:24:18.290775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba75e8-9982-4448-b624-97075de03fbc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:18.291151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba75e8-9982-4448-b624-97075de03fbc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:18.291313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba75e8-9982-4448-b624-97075de03fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:18.309405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-02ba75e8-9982-4448-b624-97075de03fbc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:24:18.310568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-02ba75e8-9982-4448-b624-97075de03fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:24:18.374678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 455/899] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:24:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:24:18.645062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91adf5-e904-4a27-8941-55f3cbf84030 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:18.680278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:18.744858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91adf5-e904-4a27-8941-55f3cbf84030 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:18.775997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:18.776628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:18.776906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:18.777170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:18.787967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:24:18.792724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:24:18.796544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:24:18.797647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 445/900] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:24:18.800378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba75e8-9982-4448-b624-97075de03fbc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:18.857189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:18.899279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba75e8-9982-4448-b624-97075de03fbc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:18.932955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:18.933549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:18.933829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:18.934101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:18.934757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:18.935060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:18.936414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:18.944214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 456/901] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:18.950209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.038885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:19.044955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d8ce-f23a-4362-843a-7deed1100010 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.076856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.077449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.077721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.077985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] PATH_INFO: `/v3/users/be49f6fedc4f450d906879aa14cda65d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.079076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] RBAC: Authorizing `identity:get_user(user_id=be49f6fedc4f450d906879aa14cda65d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:19.081054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:19.082574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 446/902] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Nov 2 07:24:18 2022] GET /identity/v3/users/be49f6fedc4f450d906879aa14cda65d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:19.088145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.185644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5ec81-572d-48b0-b6d9-f931835a7b84 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.201842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:19.218667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.219259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.219538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.219810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.285492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:19.286916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:19.379070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 457/903] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:24:19.385034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.480837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e90cd5-391b-43f0-b430-413fdd80ae63 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.512910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce860d12-9de9-4622-8020-0684fccea46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.513524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860d12-9de9-4622-8020-0684fccea46b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.513796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860d12-9de9-4622-8020-0684fccea46b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.514059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860d12-9de9-4622-8020-0684fccea46b None admin] PATH_INFO: `/v3/projects/ca50c83f544b412c8ffaee8d4c05f88c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.515142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce860d12-9de9-4622-8020-0684fccea46b None admin] RBAC: Authorizing `identity:get_project(project_id=ca50c83f544b412c8ffaee8d4c05f88c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:19.516587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce860d12-9de9-4622-8020-0684fccea46b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:19.518845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 447/904] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/projects/ca50c83f544b412c8ffaee8d4c05f88c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:19.524794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:24:19.542613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:19.619097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8072-d032-4f8b-9709-2120e00bd897 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:24:19.652715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe6c89-b613-4e01-a939-b257c4cd6910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:24:19.653291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe6c89-b613-4e01-a939-b257c4cd6910 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:24:19.653562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe6c89-b613-4e01-a939-b257c4cd6910 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:24:19.653824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe6c89-b613-4e01-a939-b257c4cd6910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:24:19.654523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe6c89-b613-4e01-a939-b257c4cd6910 None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=ca50c83f544b412c8ffaee8d4c05f88c, user.id=be49f6fedc4f450d906879aa14cda65d) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:24:19.655071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe6c89-b613-4e01-a939-b257c4cd6910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:24:19.656487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe6c89-b613-4e01-a939-b257c4cd6910 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:24:19.661990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 458/905] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:24:19 2022] GET /identity/v3/role_assignments?user.id=be49f6fedc4f450d906879aa14cda65d&scope.project.id=ca50c83f544b412c8ffaee8d4c05f88c&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:24:29.509415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:24:29.659503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=59 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:32.393806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae79c0-bae2-448e-baae-4c7eb400e5be None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.394390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae79c0-bae2-448e-baae-4c7eb400e5be None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.394390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae79c0-bae2-448e-baae-4c7eb400e5be None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.395665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 448/906] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:32.401065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baed9-bab1-4430-93a5-fe170324ec9e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.404521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baed9-bab1-4430-93a5-fe170324ec9e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.404521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baed9-bab1-4430-93a5-fe170324ec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.419938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-124baed9-bab1-4430-93a5-fe170324ec9e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:32.421167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-124baed9-bab1-4430-93a5-fe170324ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:32.489346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 459/907] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:32.760976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae79c0-bae2-448e-baae-4c7eb400e5be None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:32.860411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae79c0-bae2-448e-baae-4c7eb400e5be None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:32.892554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:32.893164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:32.893435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:32.893698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:32.903828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:32.905781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:32.919286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:32.921123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:32.922345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:32.922345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:32.922345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:32.922345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 449/908] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:32.927201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124baed9-bab1-4430-93a5-fe170324ec9e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:33.023354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124baed9-bab1-4430-93a5-fe170324ec9e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:33.052324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:33.057800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9951d86-2700-4c67-b735-7144e8739b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:33.058383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951d86-2700-4c67-b735-7144e8739b55 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:33.058654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951d86-2700-4c67-b735-7144e8739b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:33.058914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9951d86-2700-4c67-b735-7144e8739b55 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:33.059550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9951d86-2700-4c67-b735-7144e8739b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:33.059827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9951d86-2700-4c67-b735-7144e8739b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:33.061333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9951d86-2700-4c67-b735-7144e8739b55 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:33.072210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 460/909] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:33.077981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:33.130071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:33.176675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a874ded-2256-4dc9-825b-176654037425 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:33.209330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8d6c7-50d9-408b-87bf-2b3024e4c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:33.209922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8d6c7-50d9-408b-87bf-2b3024e4c5d8 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:33.210196 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8d6c7-50d9-408b-87bf-2b3024e4c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:33.210465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8d6c7-50d9-408b-87bf-2b3024e4c5d8 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:33.211104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8d6c7-50d9-408b-87bf-2b3024e4c5d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:33.212538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8d6c7-50d9-408b-87bf-2b3024e4c5d8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:33.321406 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 450/910] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Nov 2 07:25:33 2022] POST /identity/v3/users => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:35.460464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8c77-f52e-4dc2-b37a-61f96c3e3d3e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.461064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8c77-f52e-4dc2-b37a-61f96c3e3d3e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.461064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca8c77-f52e-4dc2-b37a-61f96c3e3d3e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.462256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 461/911] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:35.467468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c8d3d-bd17-4380-a1bf-65e0debda873 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.467872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c8d3d-bd17-4380-a1bf-65e0debda873 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.468023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c8d3d-bd17-4380-a1bf-65e0debda873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.486717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f42c8d3d-bd17-4380-a1bf-65e0debda873 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:35.491349 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f42c8d3d-bd17-4380-a1bf-65e0debda873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:35.554305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 451/912] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:35.821112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8c77-f52e-4dc2-b37a-61f96c3e3d3e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:35.921144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca8c77-f52e-4dc2-b37a-61f96c3e3d3e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:35.955477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:35.956098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:35.956378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:35.956677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:35.967128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:35.971940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:35.974445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:35.975516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 462/913] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:35.979187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c8d3d-bd17-4380-a1bf-65e0debda873 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.017610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.074620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c8d3d-bd17-4380-a1bf-65e0debda873 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.107878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.108515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.108791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.109058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.109712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:36.110008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.111358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.124585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 452/914] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:36.125952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.175383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.223468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28220-a65b-490b-b5b7-cc482b1c9c8c None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.255449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.256057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.256329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.256624 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.267764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.272523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:36.282939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:36.284119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:36.285653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:36.285653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:36.285653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:36.285653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 463/915] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:36.289926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.386792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.389700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff20692-5971-4ac1-8e44-6206cb9d779a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.421836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.422433 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.422709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.422978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.423609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:36.423907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.425306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.437150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 453/916] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:36.442812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.542373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ede1c-21b9-4499-94db-7d9502b3440e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.543881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:36.575556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.576184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.576484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.576755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.584019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.585460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:36.596253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:36.597423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:36.598766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 464/917] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:36.603326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.703502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80314e97-d35b-4398-8dd4-b3e7277b92b8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.736988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.737584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.737862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.738134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.738851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:36.739155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.740613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.757134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 454/918] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:36.762951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.859031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b67be-05e9-4ef6-abe2-9f9a08bc282b None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:36.890550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:36.891148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:36.891418 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:36.891680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:36.901563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:36.902973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:36.917860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:36.918956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:36.920466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:36.920466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:36.920466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:36.920466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 465/919] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:36.925362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:36.943766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.022946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da256a8-47f2-4ca4-b596-c64263a8f7e9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.056743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.057346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.057625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.057893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.058522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:37.058824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.060175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.071042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 455/920] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:37.077358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.093950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.176416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e45cc-889b-410d-835b-6e0501d968da None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.208713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.209288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.209568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.209836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.216617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.219200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:37.230267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:37.231348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:37.232573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 466/921] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:37.237417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.315621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.336527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab5b25-ca0d-41ac-9046-1e49ac99a2ec None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.369375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159efc1-f60f-4413-8f17-f296f41c52e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.369971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159efc1-f60f-4413-8f17-f296f41c52e6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.370249 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159efc1-f60f-4413-8f17-f296f41c52e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.370518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159efc1-f60f-4413-8f17-f296f41c52e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.371199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159efc1-f60f-4413-8f17-f296f41c52e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:37.371498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159efc1-f60f-4413-8f17-f296f41c52e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.372982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159efc1-f60f-4413-8f17-f296f41c52e6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.385189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 456/922] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:37.391887 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:37.467377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:37.490692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e619e-1f54-4804-a3fc-3cb4510c6496 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:37.523568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79122a4-7e6c-46c0-b647-aab5a4b35dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:37.524505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79122a4-7e6c-46c0-b647-aab5a4b35dc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:37.524778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79122a4-7e6c-46c0-b647-aab5a4b35dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:37.525095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79122a4-7e6c-46c0-b647-aab5a4b35dc7 None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/c641dd28386e464cad2add5e42c5a518/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:37.538886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79122a4-7e6c-46c0-b647-aab5a4b35dc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=c641dd28386e464cad2add5e42c5a518, role_id=fd0ef19bc1bb4e4fa93c50d4be28ba9a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:37.540293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79122a4-7e6c-46c0-b647-aab5a4b35dc7 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:37.725009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 467/923] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:37 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/c641dd28386e464cad2add5e42c5a518/roles/fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:39.844365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01fc01-dc60-4a18-8076-4d72b78964f2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.844955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01fc01-dc60-4a18-8076-4d72b78964f2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.844955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01fc01-dc60-4a18-8076-4d72b78964f2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.846324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 457/924] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:39.851543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c38d9-0f19-4001-97b1-83b231aab261 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:39.851935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c38d9-0f19-4001-97b1-83b231aab261 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:39.852084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c38d9-0f19-4001-97b1-83b231aab261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:39.870190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7d6c38d9-0f19-4001-97b1-83b231aab261 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:39.871366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7d6c38d9-0f19-4001-97b1-83b231aab261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:39.937617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 468/925] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:40.203836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01fc01-dc60-4a18-8076-4d72b78964f2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.301997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01fc01-dc60-4a18-8076-4d72b78964f2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.334632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.335242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.335520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.335789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.342491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.346224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:40.350997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:40.352189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:40.353519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 458/926] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:40.358198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c38d9-0f19-4001-97b1-83b231aab261 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.413065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.456746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c38d9-0f19-4001-97b1-83b231aab261 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.488948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.489537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.489810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.490073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.490714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] RBAC: Adding query filter params (name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:40.491005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.492340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.500368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 469/927] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:40.506522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.603973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f7142-abaf-4e7e-ac80-2cf8a5378a8f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.638473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.639093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.639372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.639740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.650306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.651740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:40.666331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:40.667372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:40.668828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:40.668828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:40.668828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:40.668828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 459/928] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:40.673280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.770403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e638ed-8cec-4e88-87e2-2a9abb64c421 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.785982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.803272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.803853 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.804125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.804390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.805086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:40.805449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.806783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.818572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 470/929] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:40.824501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:40.872553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:40.920223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c73b-88d8-40a8-9d47-8a5a9eb7b1c7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:40.953353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:40.953968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:40.954242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:40.954508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:40.961876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:40.963305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:40.974030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:40.975232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:40.976457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 460/930] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:40.981039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.078778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59883a-dd2f-44db-8e57-9ffa2eb04c82 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.111984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.112600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.112877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.113145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.113866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:41.114165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.115614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.133769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 471/931] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Nov 2 07:25:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:41.139320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.238374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cac6f-2ab1-4cd2-bb2c-f16ba396b52f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.248143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.269863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.270454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.275148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.275148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.334561 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.336004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.429994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 461/932] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:25:41.435823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.469080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.534927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826e7e5-da58-4418-91ef-bc08f4a3cf4f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.567683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.568298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.568605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.568874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.579008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.580507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:41.595190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:41.596348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:41.597507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:41.597507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:41.597507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:41.597507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 472/933] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:41.602052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.613621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.697243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091d6f-6979-4b52-a1ab-048c6928797e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.730814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.731405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.731680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.731945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.732604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:41.732906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.734258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.745117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 462/934] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:41.750790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.836516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:41.851025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a694e3f-d46f-4551-b1a2-449e055faeb2 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:41.883496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:41.884101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:41.884382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:41.884677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:41.891752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:41.893203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:41.904315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:41.905515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:41.906687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 473/935] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:41.911383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:41.979671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:42.009558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d405a6-0126-455b-be95-68054680e9d2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:42.041661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e38fa1-2c4d-4160-aed5-a033022f3b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:42.042257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e38fa1-2c4d-4160-aed5-a033022f3b07 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.042531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e38fa1-2c4d-4160-aed5-a033022f3b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.042797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e38fa1-2c4d-4160-aed5-a033022f3b07 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.043470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e38fa1-2c4d-4160-aed5-a033022f3b07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:42.043770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e38fa1-2c4d-4160-aed5-a033022f3b07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:42.045204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e38fa1-2c4d-4160-aed5-a033022f3b07 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:42.057376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 463/936] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:42.063973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:42.164609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af50ce-c6b9-4dbb-ae5f-b4569e4bc875 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:42.196718 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca6a16-7f18-48fc-ac9c-b6d69de9c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:42.197299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6a16-7f18-48fc-ac9c-b6d69de9c809 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:42.197580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6a16-7f18-48fc-ac9c-b6d69de9c809 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:42.197846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca6a16-7f18-48fc-ac9c-b6d69de9c809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:42.198557 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca6a16-7f18-48fc-ac9c-b6d69de9c809 None admin] RBAC: Adding query filter params (role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=c641dd28386e464cad2add5e42c5a518) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:42.198858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca6a16-7f18-48fc-ac9c-b6d69de9c809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:42.200272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca6a16-7f18-48fc-ac9c-b6d69de9c809 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:42.206392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 474/937] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:42 2022] GET /identity/v3/role_assignments?user.id=c641dd28386e464cad2add5e42c5a518&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=fd0ef19bc1bb4e4fa93c50d4be28ba9a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:44.372645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca566a4-6e92-40e7-a6b1-b659b88668f8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.373138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca566a4-6e92-40e7-a6b1-b659b88668f8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.373138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca566a4-6e92-40e7-a6b1-b659b88668f8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.374486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 464/938] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:44.379816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80ec52-be8a-42c9-814a-43b8a6666f3e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.386451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80ec52-be8a-42c9-814a-43b8a6666f3e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.386451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80ec52-be8a-42c9-814a-43b8a6666f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.398108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cd80ec52-be8a-42c9-814a-43b8a6666f3e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:44.399261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cd80ec52-be8a-42c9-814a-43b8a6666f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:44.401947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:44.464003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 475/939] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:44.740738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca566a4-6e92-40e7-a6b1-b659b88668f8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.839380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca566a4-6e92-40e7-a6b1-b659b88668f8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:44.867218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:44.872889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:44.873532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:44.874306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:44.874571 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:44.884318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:44.889270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:44.890941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:44.891833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 465/940] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:44.896941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80ec52-be8a-42c9-814a-43b8a6666f3e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:44.990615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80ec52-be8a-42c9-814a-43b8a6666f3e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.024134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.024705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.024980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.025244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.025895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.026187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.027544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.035716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 476/941] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:45.041477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.141570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d221-ecb7-44f7-9e3c-c4976fb37aa6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.173969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.174639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.174942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.175208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.184996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.186977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:45.200991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:45.202677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:45.203739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:45.203739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:45.203739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:45.203739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 466/942] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 07:25:45.208514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.212906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.303112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb842e-4960-44ec-9b00-cf14db9c28ba None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.334971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.335554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.335827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.336153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.336764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.337270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.338920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.350665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 477/943] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:45.356340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.400926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.455356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf948-f2e2-41d3-aab7-dc4510f06abe None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.487579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.488185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.488502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.488750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.495833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.497475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:45.509609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:45.510734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:45.511890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 467/944] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:45.516763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.579143 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.616801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71397ed-003b-4696-98f1-9bc883d7445e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.649537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.650130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.650399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.650661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.651366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.651661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.653100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.670229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 478/945] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:45.677203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.773937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a91479-7e31-452b-919d-5c243c08ac63 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.775497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.807546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.808158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.808612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.808904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.818838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.820311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:45.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:45.836760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:45.837821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:45.837821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:45.837821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:45.837821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 468/946] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:45.843088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:45.940803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c79eb-2641-4bc5-a849-642ca6c07557 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:45.959933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:45.973834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:45.974422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:45.974693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:45.975062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:45.975691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:45.975986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:45.977360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:45.988695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 479/947] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:45.994357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:46.091073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494506c-49c5-4fe5-ad9d-cdf886418df2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:46.125971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:46.126590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.126866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.127131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.133659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:46.135081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:46.147234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:46.148321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:46.149278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 469/948] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:46.154456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:46.250883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91a6e-0452-43db-b85c-3d6b3145eee3 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:46.284231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe124d7-c6b8-47f6-bad9-f99c4725d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:46.284854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe124d7-c6b8-47f6-bad9-f99c4725d1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.285149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe124d7-c6b8-47f6-bad9-f99c4725d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.285404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe124d7-c6b8-47f6-bad9-f99c4725d1b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.286081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe124d7-c6b8-47f6-bad9-f99c4725d1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:46.286382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe124d7-c6b8-47f6-bad9-f99c4725d1b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:46.287800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe124d7-c6b8-47f6-bad9-f99c4725d1b2 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:46.299458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 480/949] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:46.305482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:46.321194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:46.402460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f36cb-faa3-43f8-afa6-d300842001d1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:46.434410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6983e0-0671-4cfa-8db4-55f3474ff39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:46.435060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6983e0-0671-4cfa-8db4-55f3474ff39e None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:46.435339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6983e0-0671-4cfa-8db4-55f3474ff39e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:46.435611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6983e0-0671-4cfa-8db4-55f3474ff39e None admin] PATH_INFO: `/v3/projects/53cdb029f8b44b528a7a359134d30806/users/c641dd28386e464cad2add5e42c5a518/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:46.438137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6983e0-0671-4cfa-8db4-55f3474ff39e None admin] RBAC: Authorizing `identity:create_grant(project_id=53cdb029f8b44b528a7a359134d30806, user_id=c641dd28386e464cad2add5e42c5a518, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:46.439590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6983e0-0671-4cfa-8db4-55f3474ff39e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:46.506700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 470/950] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Nov 2 07:25:46 2022] PUT /identity/v3/projects/53cdb029f8b44b528a7a359134d30806/users/c641dd28386e464cad2add5e42c5a518/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:25:48.645390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb88a1-3534-4ac4-97a8-38173dee841b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.645945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb88a1-3534-4ac4-97a8-38173dee841b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.645945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb88a1-3534-4ac4-97a8-38173dee841b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.647237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 481/951] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:48.652483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ec21a-77e6-474c-802e-7eb167367dce None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:48.652898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ec21a-77e6-474c-802e-7eb167367dce None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:48.653014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ec21a-77e6-474c-802e-7eb167367dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:48.671253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0e8ec21a-77e6-474c-802e-7eb167367dce None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:48.672422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0e8ec21a-77e6-474c-802e-7eb167367dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:48.741472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 471/952] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:49.018161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb88a1-3534-4ac4-97a8-38173dee841b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.060373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.117228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb88a1-3534-4ac4-97a8-38173dee841b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.154018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.154645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.154929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.155198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.165563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 07:25:49.170942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:49.171873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:49.172940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 482/953] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:49.178410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ec21a-77e6-474c-802e-7eb167367dce None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.181459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.274722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ec21a-77e6-474c-802e-7eb167367dce None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.307751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.308339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.308640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.308904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.309549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:49.309844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.311818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.320245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 472/954] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:49.325538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.419865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.423162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203d1ac-1e3f-4d61-8ee4-32db3f99353f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.456957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.457577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.457848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.458112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.468743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.470156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:49.484727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:49.485898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:49.486854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:49.486854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:49.486854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:49.486854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 483/955] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:49.491626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.555837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.588078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8960-223a-4658-8426-c6717258bf2a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.620049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.620667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.620941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.621236 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.621832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:49.622127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.623493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.634496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 473/956] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:49.640307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.738871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd6e0-b63c-4951-9693-ed30cc20bbbb None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.771860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.772492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.772769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.773035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.781074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.782490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 07:25:49.793386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:49.794516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:49.795537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 484/957] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:49.800547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.895944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdb752-2c0d-4788-ade5-e80e0298c42d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:49.921067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:49.929453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:49.930068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:49.930341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:49.930602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:49.931307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:49.931603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:49.933088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:49.950319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 474/958] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:49.956878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:49.972285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.053464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9a6e4-62a4-4cbd-9122-21ab151f697e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.085619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.086211 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.086486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.086751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.154179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.155603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.168998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.251197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 485/959] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Nov 2 07:25:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 07:25:50.257022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.355144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53005-e118-4e2c-9fbe-ca437acd1cb5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.388321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.388990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.389802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.390204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.400218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.401692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 07:25:50.416058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:50.417231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 07:25:50.418327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 07:25:50.418327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 07:25:50.418327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:50.418327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 475/960] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:50.422938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.522687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba4e4b-f58b-4ed9-943c-0663cc5cec62 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.536442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.557981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.558568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.558840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.559102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.559723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.560015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.562032 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.573258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 486/961] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.578919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.613383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.676038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201180f-6a4e-4548-b04c-f7b87fbbb8d9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.707949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.708581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.708856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.709120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.715389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.716894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 07:25:50.728763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:50.734469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Nov 02 07:25:50.735509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 476/962] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:50.736366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.838182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7fc96-e374-4bba-8912-855653e33f04 None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:50.870725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da0439-bc8c-461f-9f79-575daea47dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:50.871310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0439-bc8c-461f-9f79-575daea47dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:50.871581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0439-bc8c-461f-9f79-575daea47dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:50.871842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0439-bc8c-461f-9f79-575daea47dc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:50.872539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0439-bc8c-461f-9f79-575daea47dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:50.872836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0439-bc8c-461f-9f79-575daea47dc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:50.875001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0439-bc8c-461f-9f79-575daea47dc1 None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:50.886449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 487/963] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:50.892730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:50.986795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:50.992550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9bf52-b836-44a7-b390-6c14b7f79133 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:51.023756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05d91-7a18-485f-96c9-41865c758765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:51.024338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05d91-7a18-485f-96c9-41865c758765 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:51.024640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05d91-7a18-485f-96c9-41865c758765 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:51.024905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05d91-7a18-485f-96c9-41865c758765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:51.025615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05d91-7a18-485f-96c9-41865c758765 None admin] RBAC: Adding query filter params (role.id=cf59326ec88f4f0a8360d606d4a06a18, scope.project.id=53cdb029f8b44b528a7a359134d30806, user.id=c641dd28386e464cad2add5e42c5a518) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:51.025917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05d91-7a18-485f-96c9-41865c758765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:51.027326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05d91-7a18-485f-96c9-41865c758765 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:51.033735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 477/964] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Nov 2 07:25:50 2022] GET /identity/v3/role_assignments?user.id=c641dd28386e464cad2add5e42c5a518&scope.project.id=53cdb029f8b44b528a7a359134d30806&role.id=cf59326ec88f4f0a8360d606d4a06a18 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:25:53.187876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaead6-3720-4e7e-8c4f-3d1705cc950c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.188453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaead6-3720-4e7e-8c4f-3d1705cc950c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.188453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaead6-3720-4e7e-8c4f-3d1705cc950c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.189780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 488/965] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:53.195203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218313c-04cd-429d-81f9-13ecf0deec2f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.195642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218313c-04cd-429d-81f9-13ecf0deec2f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.195748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218313c-04cd-429d-81f9-13ecf0deec2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.214286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c218313c-04cd-429d-81f9-13ecf0deec2f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:53.218003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c218313c-04cd-429d-81f9-13ecf0deec2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:53.279139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 478/966] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:53.544761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaead6-3720-4e7e-8c4f-3d1705cc950c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.576610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.645460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaead6-3720-4e7e-8c4f-3d1705cc950c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.678344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.678963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.679261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.679529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.680104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.681495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:53.690764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:53.692147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:53.693335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 489/967] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:53.697991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218313c-04cd-429d-81f9-13ecf0deec2f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.786098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.796017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218313c-04cd-429d-81f9-13ecf0deec2f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.828983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc75a3-3fb5-46ed-a7f1-b4b359bbbd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.829573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc75a3-3fb5-46ed-a7f1-b4b359bbbd98 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.829850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc75a3-3fb5-46ed-a7f1-b4b359bbbd98 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.830117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc75a3-3fb5-46ed-a7f1-b4b359bbbd98 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.830726 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc75a3-3fb5-46ed-a7f1-b4b359bbbd98 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:53.831022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc75a3-3fb5-46ed-a7f1-b4b359bbbd98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.832364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc75a3-3fb5-46ed-a7f1-b4b359bbbd98 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.839160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 479/968] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:53.843000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:53.938065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:53.943941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5a26-2733-449f-87f8-1682b2da179f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:53.976065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e017d5c-f650-4f99-ae89-31c3c6ead13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:53.976679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e017d5c-f650-4f99-ae89-31c3c6ead13b None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:53.976955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e017d5c-f650-4f99-ae89-31c3c6ead13b None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:53.977218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e017d5c-f650-4f99-ae89-31c3c6ead13b None admin] PATH_INFO: `/v3/services` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:53.977825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e017d5c-f650-4f99-ae89-31c3c6ead13b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:53.978117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e017d5c-f650-4f99-ae89-31c3c6ead13b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:53.979459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e017d5c-f650-4f99-ae89-31c3c6ead13b None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:53.984468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 490/969] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Nov 2 07:25:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:56.094611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64dd01-dbd9-4a60-8bdd-2d9136624014 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.095174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64dd01-dbd9-4a60-8bdd-2d9136624014 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.095174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64dd01-dbd9-4a60-8bdd-2d9136624014 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.096517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 480/970] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:56.102017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4233-8937-45ff-8a4c-fd8ef21823e6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.102425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4233-8937-45ff-8a4c-fd8ef21823e6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.102569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4233-8937-45ff-8a4c-fd8ef21823e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.120658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-14ae4233-8937-45ff-8a4c-fd8ef21823e6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:56.121838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-14ae4233-8937-45ff-8a4c-fd8ef21823e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:56.187442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 491/971] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:56.452221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64dd01-dbd9-4a60-8bdd-2d9136624014 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:56.550697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64dd01-dbd9-4a60-8bdd-2d9136624014 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:56.585338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39918fb7-d092-471a-ade0-b1cd47307793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:56.585930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918fb7-d092-471a-ade0-b1cd47307793 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:56.586210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918fb7-d092-471a-ade0-b1cd47307793 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:56.586486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918fb7-d092-471a-ade0-b1cd47307793 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:56.587125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39918fb7-d092-471a-ade0-b1cd47307793 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:56.588499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39918fb7-d092-471a-ade0-b1cd47307793 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:56.651566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 481/972] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Nov 2 07:25:56 2022] POST /identity/v3/services => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:25:58.814848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b3ac-a273-40c8-b46f-970122485c05 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.815406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b3ac-a273-40c8-b46f-970122485c05 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.815406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0b3ac-a273-40c8-b46f-970122485c05 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.816792 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 492/973] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:25:58.821886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85d6bb-c270-4518-bb20-bb619bcddd58 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:58.822300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85d6bb-c270-4518-bb20-bb619bcddd58 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:58.822444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85d6bb-c270-4518-bb20-bb619bcddd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:58.841002 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fd85d6bb-c270-4518-bb20-bb619bcddd58 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:25:58.842738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fd85d6bb-c270-4518-bb20-bb619bcddd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:25:58.852107 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:58.915021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 482/974] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:25:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:25:59.184273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0b3ac-a273-40c8-b46f-970122485c05 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.274212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.284808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0b3ac-a273-40c8-b46f-970122485c05 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.317844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.318449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.318730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.319002 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.319580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.320977 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:25:59.330154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:25:59.331459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:25:59.332358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 493/975] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:25:59.337437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85d6bb-c270-4518-bb20-bb619bcddd58 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.438643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85d6bb-c270-4518-bb20-bb619bcddd58 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.476713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.477320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.477597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.477863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.478495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:59.478843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.480197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.491407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 483/976] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:59.493059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.600923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6ee13-56cd-4695-a1aa-98aa2657fd0f None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.637292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d47bf-5371-4e01-9c03-7b356d4ac2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.637899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d47bf-5371-4e01-9c03-7b356d4ac2ee None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.638178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d47bf-5371-4e01-9c03-7b356d4ac2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.638450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d47bf-5371-4e01-9c03-7b356d4ac2ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.639159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d47bf-5371-4e01-9c03-7b356d4ac2ee None admin] RBAC: Adding query filter params (interface=public, service_id=c887f220d5774965856eded440c415d0, region_id=RegionOne) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:25:59.639466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d47bf-5371-4e01-9c03-7b356d4ac2ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.640882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d47bf-5371-4e01-9c03-7b356d4ac2ee None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.646793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 494/977] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/endpoints?service_id=c887f220d5774965856eded440c415d0&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:25:59.652540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:25:59.656797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:25:59.758432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85549e0-3016-40e8-a23a-bf5dcec468dd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:25:59.792017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9df63a-da15-48ce-9768-91140764f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:25:59.792781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9df63a-da15-48ce-9768-91140764f4bd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:25:59.793061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9df63a-da15-48ce-9768-91140764f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:25:59.793328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9df63a-da15-48ce-9768-91140764f4bd None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:25:59.793920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9df63a-da15-48ce-9768-91140764f4bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:25:59.795834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9df63a-da15-48ce-9768-91140764f4bd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:25:59.802761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 484/978] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Nov 2 07:25:59 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:26:01.950381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedaa32-60e8-4788-8027-06563dcf3657 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.950990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedaa32-60e8-4788-8027-06563dcf3657 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.950990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedaa32-60e8-4788-8027-06563dcf3657 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.952236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 495/979] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:26:01.957713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eea1-a4ba-4e39-bbf9-4ee7765ee491 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:01.958091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eea1-a4ba-4e39-bbf9-4ee7765ee491 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:01.959962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eea1-a4ba-4e39-bbf9-4ee7765ee491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:01.976086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e2a2eea1-a4ba-4e39-bbf9-4ee7765ee491 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:26:01.977268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e2a2eea1-a4ba-4e39-bbf9-4ee7765ee491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:26:02.036639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:02.041826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 485/980] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:26:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 07:26:02.318366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedaa32-60e8-4788-8027-06563dcf3657 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:02.337435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:02.418309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedaa32-60e8-4788-8027-06563dcf3657 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:02.450633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:02.451247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:02.451526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:02.451797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:02.452370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:02.453751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 07:26:02.462241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 07:26:02.468150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application with Lock( Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self._enter() Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application return self.creator() Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application created_value = creator( Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: ERROR keystone.server.flask.application Nov 02 07:26:02.469236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 496/981] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Nov 2 07:26:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 07:26:02.470104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2eea1-a4ba-4e39-bbf9-4ee7765ee491 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:02.567348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2eea1-a4ba-4e39-bbf9-4ee7765ee491 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:02.604875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c0747-cebd-49dd-9d29-c88f7e1540c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:02.606087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0747-cebd-49dd-9d29-c88f7e1540c8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:02.606563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0747-cebd-49dd-9d29-c88f7e1540c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:02.607078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0747-cebd-49dd-9d29-c88f7e1540c8 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:02.608193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c0747-cebd-49dd-9d29-c88f7e1540c8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:26:02.608643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c0747-cebd-49dd-9d29-c88f7e1540c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:02.610283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c0747-cebd-49dd-9d29-c88f7e1540c8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:02.615551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 486/982] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Nov 2 07:26:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:26:02.621372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:26:02.702243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:02.720315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d6aa-f412-4979-b101-2a9d6275500e None admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:26:02.754594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e593-617c-4c85-ba09-227838e24bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:26:02.755193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e593-617c-4c85-ba09-227838e24bda None admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:26:02.755471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e593-617c-4c85-ba09-227838e24bda None admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:26:02.755739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e593-617c-4c85-ba09-227838e24bda None admin] PATH_INFO: `/v3/endpoints` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:26:02.756469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4e593-617c-4c85-ba09-227838e24bda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:26:02.766333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4e593-617c-4c85-ba09-227838e24bda None admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:26:02.851380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 497/983] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:26:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:26:12.612475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=69 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:26:12.846775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:13.584752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18d501-6750-404f-a132-8acfeaac03e7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:13.585326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18d501-6750-404f-a132-8acfeaac03e7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:13.585602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18d501-6750-404f-a132-8acfeaac03e7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:13.588768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 487/984] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:13.592455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62bcef-b404-4091-bea8-6f881b97b4f1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:13.592891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62bcef-b404-4091-bea8-6f881b97b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:13.593216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62bcef-b404-4091-bea8-6f881b97b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:13.687892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8f62bcef-b404-4091-bea8-6f881b97b4f1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:13.689458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8f62bcef-b404-4091-bea8-6f881b97b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:13.855126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 498/985] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:14.177835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b779a-6a05-4e4b-aa5a-a4c9f8b04ac7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:14.177835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b779a-6a05-4e4b-aa5a-a4c9f8b04ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:14.177835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b779a-6a05-4e4b-aa5a-a4c9f8b04ac7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:14.177835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 488/986] 10.222.0.39 () {54 vars in 965 bytes} [Wed Nov 2 07:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:14.183020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2379b-286c-4984-87a3-bae51f4d9f4c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:14.183302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2379b-286c-4984-87a3-bae51f4d9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:14.183571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2379b-286c-4984-87a3-bae51f4d9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:14.268498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-59e2379b-286c-4984-87a3-bae51f4d9f4c None None] MFA Rules not processed for user `60e4cc87886d4b7788864eaf94334e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:14.269809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-59e2379b-286c-4984-87a3-bae51f4d9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:14.293838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:14.357511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 499/987] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Nov 2 07:32:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:14.366953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b779a-6a05-4e4b-aa5a-a4c9f8b04ac7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:14.369174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-da4b779a-6a05-4e4b-aa5a-a4c9f8b04ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:14.490060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b779a-6a05-4e4b-aa5a-a4c9f8b04ac7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:14.577057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c688c-a3ff-48ad-ad5c-5f6fd22c00dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:14.577958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c688c-a3ff-48ad-ad5c-5f6fd22c00dd service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:14.578503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c688c-a3ff-48ad-ad5c-5f6fd22c00dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:14.579118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c688c-a3ff-48ad-ad5c-5f6fd22c00dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:14.580986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-339c688c-a3ff-48ad-ad5c-5f6fd22c00dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:14.643360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:14.711775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c688c-a3ff-48ad-ad5c-5f6fd22c00dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:14.713908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c688c-a3ff-48ad-ad5c-5f6fd22c00dd service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:14.744877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 489/988] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:17.261661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5ed8a-b521-4c60-bbbc-8d02858af150 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:17.262269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5ed8a-b521-4c60-bbbc-8d02858af150 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:17.262269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5ed8a-b521-4c60-bbbc-8d02858af150 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:17.263551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 500/989] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:17.269393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76651-3f8e-409e-9da4-9382bb85ffe9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:17.269924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76651-3f8e-409e-9da4-9382bb85ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:17.269924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76651-3f8e-409e-9da4-9382bb85ffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:17.360208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f1b76651-3f8e-409e-9da4-9382bb85ffe9 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:17.361429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f1b76651-3f8e-409e-9da4-9382bb85ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:17.456873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 490/990] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:17.744447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5ed8a-b521-4c60-bbbc-8d02858af150 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:17.745997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5ed5ed8a-b521-4c60-bbbc-8d02858af150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:17.847275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5ed8a-b521-4c60-bbbc-8d02858af150 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:17.916958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:17.919203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126900d-87d8-4c88-9782-09a634e41ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:17.919799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126900d-87d8-4c88-9782-09a634e41ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:17.920077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126900d-87d8-4c88-9782-09a634e41ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:17.920347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126900d-87d8-4c88-9782-09a634e41ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:17.921958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f126900d-87d8-4c88-9782-09a634e41ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:18.027300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126900d-87d8-4c88-9782-09a634e41ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:18.028670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126900d-87d8-4c88-9782-09a634e41ac7 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:18.046781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 501/991] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:20.622059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ac0f5-c879-40fd-9f8e-00c4d768e18c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:20.622587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ac0f5-c879-40fd-9f8e-00c4d768e18c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:20.622587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ac0f5-c879-40fd-9f8e-00c4d768e18c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:20.623933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 491/992] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:20.629064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45544e8-09e3-4aca-9a10-e0ce498d1f88 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:20.629493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45544e8-09e3-4aca-9a10-e0ce498d1f88 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:20.629616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45544e8-09e3-4aca-9a10-e0ce498d1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:20.695259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e45544e8-09e3-4aca-9a10-e0ce498d1f88 None None] MFA Rules not processed for user `a24fab6fb50c48feb5ea274c9c664024`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:20.696473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e45544e8-09e3-4aca-9a10-e0ce498d1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:20.746884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:20.792379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 502/993] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:21.076089 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ac0f5-c879-40fd-9f8e-00c4d768e18c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:21.077668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-284ac0f5-c879-40fd-9f8e-00c4d768e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:21.087335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:21.180680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ac0f5-c879-40fd-9f8e-00c4d768e18c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:21.251440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de2806-6c3a-47fd-8fab-d4a2b5c3d8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:21.253219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2806-6c3a-47fd-8fab-d4a2b5c3d8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:21.253219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2806-6c3a-47fd-8fab-d4a2b5c3d8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:21.253219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de2806-6c3a-47fd-8fab-d4a2b5c3d8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:21.254280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-46de2806-6c3a-47fd-8fab-d4a2b5c3d8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:21.316230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:21.362293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2806-6c3a-47fd-8fab-d4a2b5c3d8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:21.363719 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de2806-6c3a-47fd-8fab-d4a2b5c3d8b1 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:21.381097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 492/994] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:24.243966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd71f-b7fb-49bb-b64f-6de1657e45fa None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:24.244532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd71f-b7fb-49bb-b64f-6de1657e45fa None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:24.244532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd71f-b7fb-49bb-b64f-6de1657e45fa None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:24.245871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 503/995] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:24.251037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85780b1f-312c-4d31-b9df-1dc30c60dadf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:24.251413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85780b1f-312c-4d31-b9df-1dc30c60dadf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:24.251590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85780b1f-312c-4d31-b9df-1dc30c60dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:24.318033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-85780b1f-312c-4d31-b9df-1dc30c60dadf None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:24.319225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-85780b1f-312c-4d31-b9df-1dc30c60dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:24.413435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 493/996] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:24.698681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd71f-b7fb-49bb-b64f-6de1657e45fa None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:24.700196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f3afd71f-b7fb-49bb-b64f-6de1657e45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:24.799858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd71f-b7fb-49bb-b64f-6de1657e45fa None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:24.870814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca160e-d465-4c30-9fb4-766a6e8165ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:24.871399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca160e-d465-4c30-9fb4-766a6e8165ee service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:24.871676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca160e-d465-4c30-9fb4-766a6e8165ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:24.871945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca160e-d465-4c30-9fb4-766a6e8165ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:24.873548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-86ca160e-d465-4c30-9fb4-766a6e8165ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:24.881646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:24.979390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca160e-d465-4c30-9fb4-766a6e8165ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:24.980745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca160e-d465-4c30-9fb4-766a6e8165ee service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:24.998872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 504/997] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:28.072388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec2442-ee44-4c48-9dea-67535af17974 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.072927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec2442-ee44-4c48-9dea-67535af17974 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.072927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec2442-ee44-4c48-9dea-67535af17974 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.074245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 494/998] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:28.079428 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4e1a0-114d-4dfd-a6ea-2cadb66036dd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.079821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4e1a0-114d-4dfd-a6ea-2cadb66036dd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.079978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4e1a0-114d-4dfd-a6ea-2cadb66036dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.153569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b5c4e1a0-114d-4dfd-a6ea-2cadb66036dd None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:28.154756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b5c4e1a0-114d-4dfd-a6ea-2cadb66036dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:28.213001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:28.255690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 505/999] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:28.539043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec2442-ee44-4c48-9dea-67535af17974 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:28.540927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9fec2442-ee44-4c48-9dea-67535af17974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:28.560458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:28.644815 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec2442-ee44-4c48-9dea-67535af17974 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:28.717957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846157cd-3ff5-436d-b207-f0f0332cc9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:28.718473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846157cd-3ff5-436d-b207-f0f0332cc9ad service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:28.718748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846157cd-3ff5-436d-b207-f0f0332cc9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:28.719012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846157cd-3ff5-436d-b207-f0f0332cc9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:28.720598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-846157cd-3ff5-436d-b207-f0f0332cc9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:28.790847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:28.828388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846157cd-3ff5-436d-b207-f0f0332cc9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:28.829838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846157cd-3ff5-436d-b207-f0f0332cc9ad service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:28.847348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 495/1000] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:31.064953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15bde-0048-49ab-acb8-c90850ff0523 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:31.065630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15bde-0048-49ab-acb8-c90850ff0523 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:31.065630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15bde-0048-49ab-acb8-c90850ff0523 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:31.066883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 506/1001] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:31.072589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ce16-95ac-48f9-8f1b-6e5f540c2b54 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:31.073056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ce16-95ac-48f9-8f1b-6e5f540c2b54 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:31.073181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170ce16-95ac-48f9-8f1b-6e5f540c2b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:31.147893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5170ce16-95ac-48f9-8f1b-6e5f540c2b54 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:31.149125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5170ce16-95ac-48f9-8f1b-6e5f540c2b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:31.248592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 496/1002] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:31.529433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce15bde-0048-49ab-acb8-c90850ff0523 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:31.531048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7ce15bde-0048-49ab-acb8-c90850ff0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:31.635009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce15bde-0048-49ab-acb8-c90850ff0523 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:31.711530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061360-8b78-4c7a-ac23-a45bac7785ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:31.712284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061360-8b78-4c7a-ac23-a45bac7785ff service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:31.712852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061360-8b78-4c7a-ac23-a45bac7785ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:31.713120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061360-8b78-4c7a-ac23-a45bac7785ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:31.714712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-97061360-8b78-4c7a-ac23-a45bac7785ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:31.731314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:31.824623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97061360-8b78-4c7a-ac23-a45bac7785ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:31.826047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97061360-8b78-4c7a-ac23-a45bac7785ff service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:31.845417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 507/1003] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:34.073514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4461d-6508-4c03-851a-f180f322ca9e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.074070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4461d-6508-4c03-851a-f180f322ca9e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.074070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4461d-6508-4c03-851a-f180f322ca9e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.075386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 497/1004] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:34.080628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e62f19-f81c-4cd3-a740-14ec9997ef1e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.081023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e62f19-f81c-4cd3-a740-14ec9997ef1e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.081179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e62f19-f81c-4cd3-a740-14ec9997ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.147042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b0e62f19-f81c-4cd3-a740-14ec9997ef1e None None] MFA Rules not processed for user `a24fab6fb50c48feb5ea274c9c664024`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:34.148303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0e62f19-f81c-4cd3-a740-14ec9997ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.211966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.242866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 508/1005] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:34.529523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4461d-6508-4c03-851a-f180f322ca9e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:34.531076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-81c4461d-6508-4c03-851a-f180f322ca9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.563794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.639837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4461d-6508-4c03-851a-f180f322ca9e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:34.716977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29285e-7a40-4d4c-a66c-18c2f2f31bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:34.717578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29285e-7a40-4d4c-a66c-18c2f2f31bbe service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:34.717850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29285e-7a40-4d4c-a66c-18c2f2f31bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:34.718115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29285e-7a40-4d4c-a66c-18c2f2f31bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:34.719673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3c29285e-7a40-4d4c-a66c-18c2f2f31bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:34.797221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:34.829610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29285e-7a40-4d4c-a66c-18c2f2f31bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:34.831040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29285e-7a40-4d4c-a66c-18c2f2f31bbe service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:34.848844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 498/1006] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:37.494079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90b17-1513-4b6e-a880-cd077944d00a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:37.494597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90b17-1513-4b6e-a880-cd077944d00a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:37.494597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90b17-1513-4b6e-a880-cd077944d00a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:37.495875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 509/1007] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:37.500971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee451ec-2b76-4174-b252-b4a52f5605b6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:37.501341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee451ec-2b76-4174-b252-b4a52f5605b6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:37.501517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee451ec-2b76-4174-b252-b4a52f5605b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:37.566833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0ee451ec-2b76-4174-b252-b4a52f5605b6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:37.568542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0ee451ec-2b76-4174-b252-b4a52f5605b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:37.665622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 499/1008] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:37.953914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90b17-1513-4b6e-a880-cd077944d00a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:37.956622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-58e90b17-1513-4b6e-a880-cd077944d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:38.078561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90b17-1513-4b6e-a880-cd077944d00a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:38.168654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196f4f0-58b7-4d85-b351-96f6c44062af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:38.169255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196f4f0-58b7-4d85-b351-96f6c44062af service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:38.169528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196f4f0-58b7-4d85-b351-96f6c44062af service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:38.170420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196f4f0-58b7-4d85-b351-96f6c44062af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:38.172000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5196f4f0-58b7-4d85-b351-96f6c44062af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:38.199472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:38.280398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196f4f0-58b7-4d85-b351-96f6c44062af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:38.281886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196f4f0-58b7-4d85-b351-96f6c44062af service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:38.300451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 510/1009] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:40.506416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f46c82-ac2f-4768-8243-fc55d5d7acc3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:40.506961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f46c82-ac2f-4768-8243-fc55d5d7acc3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:40.506961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f46c82-ac2f-4768-8243-fc55d5d7acc3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:40.508311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 500/1010] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:40.513733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294348-7ca7-4128-a1ca-4ad30aa3a60a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:40.514140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294348-7ca7-4128-a1ca-4ad30aa3a60a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:40.514258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39294348-7ca7-4128-a1ca-4ad30aa3a60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:40.578498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-39294348-7ca7-4128-a1ca-4ad30aa3a60a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:40.579677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-39294348-7ca7-4128-a1ca-4ad30aa3a60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:40.652330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:40.674275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 511/1011] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:40.959800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f46c82-ac2f-4768-8243-fc55d5d7acc3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:40.967635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b5f46c82-ac2f-4768-8243-fc55d5d7acc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:41.001064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:41.063237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f46c82-ac2f-4768-8243-fc55d5d7acc3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:41.136029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906c3e8-107d-4d79-a0fd-107230f07a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:41.136652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906c3e8-107d-4d79-a0fd-107230f07a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:41.136927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906c3e8-107d-4d79-a0fd-107230f07a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:41.137190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906c3e8-107d-4d79-a0fd-107230f07a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:41.138752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5906c3e8-107d-4d79-a0fd-107230f07a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:41.219981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:41.244913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906c3e8-107d-4d79-a0fd-107230f07a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:41.246594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906c3e8-107d-4d79-a0fd-107230f07a1f service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:41.264917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 501/1012] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:43.947725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad123-ad1c-4880-8eea-9dcf5cf0e82c None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:43.948228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad123-ad1c-4880-8eea-9dcf5cf0e82c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:43.948228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad123-ad1c-4880-8eea-9dcf5cf0e82c None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:43.949549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 512/1013] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:43.954864 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83671e8a-66ab-41a3-b3bb-2559479572a6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:43.955278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83671e8a-66ab-41a3-b3bb-2559479572a6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:43.955430 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83671e8a-66ab-41a3-b3bb-2559479572a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:44.022636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-83671e8a-66ab-41a3-b3bb-2559479572a6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:44.023833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-83671e8a-66ab-41a3-b3bb-2559479572a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:44.120702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 502/1014] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:44.402538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad123-ad1c-4880-8eea-9dcf5cf0e82c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:44.404082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-01dad123-ad1c-4880-8eea-9dcf5cf0e82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:44.505160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad123-ad1c-4880-8eea-9dcf5cf0e82c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:44.576985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055a1aa-458f-4108-b9a5-a7b4495ea6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:44.577567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055a1aa-458f-4108-b9a5-a7b4495ea6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:44.577868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055a1aa-458f-4108-b9a5-a7b4495ea6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:44.578131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055a1aa-458f-4108-b9a5-a7b4495ea6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:44.579668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3055a1aa-458f-4108-b9a5-a7b4495ea6e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:44.613368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:44.685983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055a1aa-458f-4108-b9a5-a7b4495ea6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:44.687407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055a1aa-458f-4108-b9a5-a7b4495ea6e4 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:44.705697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 513/1015] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:49.049847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481de67-e313-41b0-a517-73a976006cb9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.050445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481de67-e313-41b0-a517-73a976006cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.050445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481de67-e313-41b0-a517-73a976006cb9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.052336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 503/1016] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:49.057783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c1f0-2296-4088-aa17-20aad2fe7b05 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.058228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c1f0-2296-4088-aa17-20aad2fe7b05 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.058455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c1f0-2296-4088-aa17-20aad2fe7b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.129937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8002c1f0-2296-4088-aa17-20aad2fe7b05 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:49.135435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8002c1f0-2296-4088-aa17-20aad2fe7b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:49.215011 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:49.225802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 514/1017] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:49.506776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481de67-e313-41b0-a517-73a976006cb9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:49.508374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9481de67-e313-41b0-a517-73a976006cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:49.558686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:49.613286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481de67-e313-41b0-a517-73a976006cb9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:49.686536 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efb19c-d10e-442c-9b7d-77f3dbac7cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:49.687142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb19c-d10e-442c-9b7d-77f3dbac7cdc service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:49.687416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb19c-d10e-442c-9b7d-77f3dbac7cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:49.687685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efb19c-d10e-442c-9b7d-77f3dbac7cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:49.689296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a4efb19c-d10e-442c-9b7d-77f3dbac7cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:49.781398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:49.800866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb19c-d10e-442c-9b7d-77f3dbac7cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:49.802292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efb19c-d10e-442c-9b7d-77f3dbac7cdc service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:49.820465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 504/1018] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:52.929903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df84e-26a2-4682-a8be-1027762ddb8e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:52.930441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df84e-26a2-4682-a8be-1027762ddb8e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:52.930441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df84e-26a2-4682-a8be-1027762ddb8e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:52.931996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 515/1019] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:52.937408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a41ce9-b66f-4e87-8264-449f30003571 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:52.937840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a41ce9-b66f-4e87-8264-449f30003571 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:52.937962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a41ce9-b66f-4e87-8264-449f30003571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:53.006271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-97a41ce9-b66f-4e87-8264-449f30003571 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:53.007475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-97a41ce9-b66f-4e87-8264-449f30003571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:53.106460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 505/1020] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:53.420902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb3c4d-1cee-4fcf-851b-d0f440f5a9b8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:53.421279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb3c4d-1cee-4fcf-851b-d0f440f5a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:53.421608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb3c4d-1cee-4fcf-851b-d0f440f5a9b8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:53.423031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 516/1021] 10.222.0.39 () {54 vars in 965 bytes} [Wed Nov 2 07:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:53.429588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1be6-10f2-4709-892f-d681a31ddb85 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:53.429876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1be6-10f2-4709-892f-d681a31ddb85 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:53.430151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a1be6-10f2-4709-892f-d681a31ddb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:53.500557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:53.509756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2c7a1be6-10f2-4709-892f-d681a31ddb85 None None] MFA Rules not processed for user `60e4cc87886d4b7788864eaf94334e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:53.510963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2c7a1be6-10f2-4709-892f-d681a31ddb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:53.585795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 506/1022] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Nov 2 07:32:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:32:53.594913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb3c4d-1cee-4fcf-851b-d0f440f5a9b8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:53.596419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-43eb3c4d-1cee-4fcf-851b-d0f440f5a9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:53.741423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb3c4d-1cee-4fcf-851b-d0f440f5a9b8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:53.822584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe3db6-bf49-4018-a802-11ce8d49d604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:53.822989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe3db6-bf49-4018-a802-11ce8d49d604 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:53.823259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe3db6-bf49-4018-a802-11ce8d49d604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:53.823541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe3db6-bf49-4018-a802-11ce8d49d604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:53.825190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-debe3db6-bf49-4018-a802-11ce8d49d604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:53.881814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:53.952152 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe3db6-bf49-4018-a802-11ce8d49d604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:53.953638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe3db6-bf49-4018-a802-11ce8d49d604 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:53.974951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 517/1023] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:32:59.019142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe465da-8710-4399-a460-2bdaf97daf64 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:59.020262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe465da-8710-4399-a460-2bdaf97daf64 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:59.020262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe465da-8710-4399-a460-2bdaf97daf64 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:59.021791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 507/1024] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:32:59.027111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ddee-08d7-4f99-a677-66be6d6acaa4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:59.027513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ddee-08d7-4f99-a677-66be6d6acaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:59.027643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ddee-08d7-4f99-a677-66be6d6acaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:59.099518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c7d8ddee-08d7-4f99-a677-66be6d6acaa4 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:32:59.100748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c7d8ddee-08d7-4f99-a677-66be6d6acaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:59.197663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:59.199848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 518/1025] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:32:59.486513 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe465da-8710-4399-a460-2bdaf97daf64 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:32:59.488051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cfe465da-8710-4399-a460-2bdaf97daf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:59.589139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe465da-8710-4399-a460-2bdaf97daf64 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:32:59.641700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:32:59.668141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8bd1-7e5f-4016-9c49-457865ab5587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:32:59.668770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8bd1-7e5f-4016-9c49-457865ab5587 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:32:59.669048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8bd1-7e5f-4016-9c49-457865ab5587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:32:59.669314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8bd1-7e5f-4016-9c49-457865ab5587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:32:59.670888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dd9b8bd1-7e5f-4016-9c49-457865ab5587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:32:59.779077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b8bd1-7e5f-4016-9c49-457865ab5587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:32:59.780580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b8bd1-7e5f-4016-9c49-457865ab5587 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:32:59.801430 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 508/1026] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:04.722232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662063-2175-451e-b28c-ef74f197691b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:04.723312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662063-2175-451e-b28c-ef74f197691b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:04.723312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662063-2175-451e-b28c-ef74f197691b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:04.724998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 519/1027] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:04.730754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681752-2ca7-4326-b6ed-db74ca891637 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:04.731526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681752-2ca7-4326-b6ed-db74ca891637 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:04.731937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4681752-2ca7-4326-b6ed-db74ca891637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:04.823157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a4681752-2ca7-4326-b6ed-db74ca891637 None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:04.824397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a4681752-2ca7-4326-b6ed-db74ca891637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:04.845247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:05.009707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 509/1028] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:33:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:09.183940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba08f1-0dc2-47b4-9749-2bf43e00b11f None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:09.184500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba08f1-0dc2-47b4-9749-2bf43e00b11f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:09.184500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba08f1-0dc2-47b4-9749-2bf43e00b11f None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:09.185846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 520/1029] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:09.193045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f3937-0ed9-4d1d-80a5-32c9fa4f815f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:09.193495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f3937-0ed9-4d1d-80a5-32c9fa4f815f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:09.193579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f3937-0ed9-4d1d-80a5-32c9fa4f815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:09.275856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1c0f3937-0ed9-4d1d-80a5-32c9fa4f815f None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:09.277088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c0f3937-0ed9-4d1d-80a5-32c9fa4f815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:09.352190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:09.391816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 510/1030] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:33:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:10.745261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327414-537b-4ffc-83c3-859249cffd0d None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.745770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327414-537b-4ffc-83c3-859249cffd0d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.745770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327414-537b-4ffc-83c3-859249cffd0d None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.747066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 521/1031] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:10.752114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a878639-f7d3-42a1-95ac-c5813b22480c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:10.752572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a878639-f7d3-42a1-95ac-c5813b22480c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:10.752817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a878639-f7d3-42a1-95ac-c5813b22480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:10.833922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8a878639-f7d3-42a1-95ac-c5813b22480c None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:10.835169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8a878639-f7d3-42a1-95ac-c5813b22480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:10.945301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 511/1032] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:14.478935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916e81-8b9d-43ff-af3c-e2e7ffb2cc20 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:14.479839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916e81-8b9d-43ff-af3c-e2e7ffb2cc20 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:14.480122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916e81-8b9d-43ff-af3c-e2e7ffb2cc20 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:14.481680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 522/1033] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:14.487189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f829278-ac78-4397-973c-6f6be8ae3988 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:14.488216 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f829278-ac78-4397-973c-6f6be8ae3988 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:14.488311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f829278-ac78-4397-973c-6f6be8ae3988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:14.527043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:14.560734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5f829278-ac78-4397-973c-6f6be8ae3988 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:14.562376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5f829278-ac78-4397-973c-6f6be8ae3988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:14.664323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 512/1034] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:14.961358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee547a6a-cc3a-4b34-84b0-d9ebb090553d None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:14.961639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee547a6a-cc3a-4b34-84b0-d9ebb090553d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:14.961906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee547a6a-cc3a-4b34-84b0-d9ebb090553d None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:14.963239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 523/1035] 10.222.0.39 () {54 vars in 961 bytes} [Wed Nov 2 07:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:14.970173 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ee7a-4316-4282-a9cf-a6386df14d55 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:14.970482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ee7a-4316-4282-a9cf-a6386df14d55 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:14.970725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1ee7a-4316-4282-a9cf-a6386df14d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:15.080703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-90a1ee7a-4316-4282-a9cf-a6386df14d55 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:15.081925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-90a1ee7a-4316-4282-a9cf-a6386df14d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:15.141405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:15.216308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 513/1036] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Nov 2 07:33:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:15.227433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee547a6a-cc3a-4b34-84b0-d9ebb090553d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:15.229525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ee547a6a-cc3a-4b34-84b0-d9ebb090553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:15.391054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee547a6a-cc3a-4b34-84b0-d9ebb090553d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:15.471546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:15.515319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cb596-4e94-4751-8365-eb4aab4cdec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:15.516060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb596-4e94-4751-8365-eb4aab4cdec1 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:15.516423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb596-4e94-4751-8365-eb4aab4cdec1 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:15.516823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cb596-4e94-4751-8365-eb4aab4cdec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:15.518505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-472cb596-4e94-4751-8365-eb4aab4cdec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:15.620388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cb596-4e94-4751-8365-eb4aab4cdec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:15.622182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cb596-4e94-4751-8365-eb4aab4cdec1 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:15.642390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 524/1037] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:18.031234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935a6a-6dfc-4024-b925-80eb34d94d3f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.031234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935a6a-6dfc-4024-b925-80eb34d94d3f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.031234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935a6a-6dfc-4024-b925-80eb34d94d3f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.031234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 514/1038] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:18.037540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3499b11-1122-4978-9132-16a9e38379ee None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.038024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3499b11-1122-4978-9132-16a9e38379ee None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.038024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3499b11-1122-4978-9132-16a9e38379ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.110652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b3499b11-1122-4978-9132-16a9e38379ee None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:18.111837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b3499b11-1122-4978-9132-16a9e38379ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:18.154100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:18.214377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 525/1039] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:18.509193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06935a6a-6dfc-4024-b925-80eb34d94d3f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:18.510721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-06935a6a-6dfc-4024-b925-80eb34d94d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:18.685062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06935a6a-6dfc-4024-b925-80eb34d94d3f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:18.696017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:18.835574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8b2c4-59a9-4060-9496-1dc2716bcaf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:18.836191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8b2c4-59a9-4060-9496-1dc2716bcaf3 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:18.836499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8b2c4-59a9-4060-9496-1dc2716bcaf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:18.836772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8b2c4-59a9-4060-9496-1dc2716bcaf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:18.838545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c9e8b2c4-59a9-4060-9496-1dc2716bcaf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:19.016690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8b2c4-59a9-4060-9496-1dc2716bcaf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:19.016690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8b2c4-59a9-4060-9496-1dc2716bcaf3 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:19.016690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 515/1040] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:21.750449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44a35-4994-44a7-bde8-6d987ae9041a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.751000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44a35-4994-44a7-bde8-6d987ae9041a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.751000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d44a35-4994-44a7-bde8-6d987ae9041a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.752305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 526/1041] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:21.758059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b0dda-cc21-4617-b546-40a6782fef79 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:21.758481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b0dda-cc21-4617-b546-40a6782fef79 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:21.758569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b0dda-cc21-4617-b546-40a6782fef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:21.774835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:21.827432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-546b0dda-cc21-4617-b546-40a6782fef79 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:21.828809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-546b0dda-cc21-4617-b546-40a6782fef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:21.935723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 516/1042] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:22.231435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341459c8-8945-4795-a5f5-bcc6490cf770 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:22.231955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341459c8-8945-4795-a5f5-bcc6490cf770 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:22.232483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341459c8-8945-4795-a5f5-bcc6490cf770 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:22.234148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 527/1043] 10.222.0.39 () {54 vars in 961 bytes} [Wed Nov 2 07:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:22.241536 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942b7a-d0e6-4153-8795-896aaea28778 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:22.244966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942b7a-d0e6-4153-8795-896aaea28778 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:22.244966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942b7a-d0e6-4153-8795-896aaea28778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:22.325672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-44942b7a-d0e6-4153-8795-896aaea28778 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:22.327183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-44942b7a-d0e6-4153-8795-896aaea28778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:22.366581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:22.458227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 517/1044] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Nov 2 07:33:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:22.466551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341459c8-8945-4795-a5f5-bcc6490cf770 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:22.468203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-341459c8-8945-4795-a5f5-bcc6490cf770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:22.627167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341459c8-8945-4795-a5f5-bcc6490cf770 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:22.648927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693435bd-07a5-40fd-ac2e-acd28d104437 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:22.649149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:22.649252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693435bd-07a5-40fd-ac2e-acd28d104437 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:22.649599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693435bd-07a5-40fd-ac2e-acd28d104437 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:22.650958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 518/1045] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:33:22.656400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8f18-acc9-4a89-9c2e-51fa18d45470 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:22.656780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8f18-acc9-4a89-9c2e-51fa18d45470 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:22.657115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8f18-acc9-4a89-9c2e-51fa18d45470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:22.732199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9adc8f18-acc9-4a89-9c2e-51fa18d45470 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:22.733756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9adc8f18-acc9-4a89-9c2e-51fa18d45470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:22.755767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf90a1-29e4-46d4-841e-abbbb4db176b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:22.756543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf90a1-29e4-46d4-841e-abbbb4db176b service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:22.756927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf90a1-29e4-46d4-841e-abbbb4db176b service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:22.757301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf90a1-29e4-46d4-841e-abbbb4db176b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:22.758987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-afcf90a1-29e4-46d4-841e-abbbb4db176b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:22.847985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:22.860462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 519/1046] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:22.864158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf90a1-29e4-46d4-841e-abbbb4db176b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:22.865892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf90a1-29e4-46d4-841e-abbbb4db176b service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:22.885315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 528/1047] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:23.189481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f19dc-60bb-472b-a5dd-56b67eec3dda None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.189481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f19dc-60bb-472b-a5dd-56b67eec3dda None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.189481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f19dc-60bb-472b-a5dd-56b67eec3dda None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.192624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 520/1048] 10.222.0.39 () {54 vars in 963 bytes} [Wed Nov 2 07:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:23.196503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb479cc-7674-4f52-80d6-e85f7bce862a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.196802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb479cc-7674-4f52-80d6-e85f7bce862a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.197029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb479cc-7674-4f52-80d6-e85f7bce862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.231106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:23.286113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ebb479cc-7674-4f52-80d6-e85f7bce862a None None] MFA Rules not processed for user `32ee11e2d4324bb7a9b83c8fd2b98bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:23.287244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ebb479cc-7674-4f52-80d6-e85f7bce862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:23.369855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 529/1049] 10.222.0.39 () {58 vars in 1060 bytes} [Wed Nov 2 07:33:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:23.377426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f19dc-60bb-472b-a5dd-56b67eec3dda None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:23.379858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6d0f19dc-60bb-472b-a5dd-56b67eec3dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:23.493493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f19dc-60bb-472b-a5dd-56b67eec3dda None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:23.576641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91293c9-4154-470f-af86-9b6cf85007a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:23.577279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91293c9-4154-470f-af86-9b6cf85007a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:23.577796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91293c9-4154-470f-af86-9b6cf85007a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:23.578057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91293c9-4154-470f-af86-9b6cf85007a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:23.579667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d91293c9-4154-470f-af86-9b6cf85007a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:23.642139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:23.703331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91293c9-4154-470f-af86-9b6cf85007a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:23.705190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91293c9-4154-470f-af86-9b6cf85007a8 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:23.730035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 521/1050] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:25.274903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28924d9-4716-4d69-9118-b56772255785 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.275469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28924d9-4716-4d69-9118-b56772255785 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.275579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28924d9-4716-4d69-9118-b56772255785 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.277161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 530/1051] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:25.282579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d95e-0457-4392-9e36-aa22031319e5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:25.283242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d95e-0457-4392-9e36-aa22031319e5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:25.289366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d95e-0457-4392-9e36-aa22031319e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:25.354081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d202d95e-0457-4392-9e36-aa22031319e5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:25.355329 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d202d95e-0457-4392-9e36-aa22031319e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.461750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 522/1052] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:25.751737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28924d9-4716-4d69-9118-b56772255785 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:25.753337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e28924d9-4716-4d69-9118-b56772255785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:25.872231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:25.908718 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28924d9-4716-4d69-9118-b56772255785 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:26.039110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e19f69-dd3f-43ef-820f-744424dec690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:26.039709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e19f69-dd3f-43ef-820f-744424dec690 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:26.039986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e19f69-dd3f-43ef-820f-744424dec690 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:26.040256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e19f69-dd3f-43ef-820f-744424dec690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:26.041867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b3e19f69-dd3f-43ef-820f-744424dec690 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:26.124352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:26.138353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e19f69-dd3f-43ef-820f-744424dec690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:26.139975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e19f69-dd3f-43ef-820f-744424dec690 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:26.159900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 531/1053] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:28.501179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec249d-6bbc-4a0d-b9e2-013ec475f8fb None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.501698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec249d-6bbc-4a0d-b9e2-013ec475f8fb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.501698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec249d-6bbc-4a0d-b9e2-013ec475f8fb None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.503167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 523/1054] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:28.508218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad53d1-0827-4eaa-80bc-063a35800c1c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:28.508755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad53d1-0827-4eaa-80bc-063a35800c1c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:28.508841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad53d1-0827-4eaa-80bc-063a35800c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:28.575855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-41ad53d1-0827-4eaa-80bc-063a35800c1c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:28.577072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-41ad53d1-0827-4eaa-80bc-063a35800c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:28.676401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 532/1055] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:28.967716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec249d-6bbc-4a0d-b9e2-013ec475f8fb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:28.969548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-17ec249d-6bbc-4a0d-b9e2-013ec475f8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:28.973541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:29.139553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec249d-6bbc-4a0d-b9e2-013ec475f8fb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:29.220858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:29.264147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd387ba4-c796-4fe2-96a3-3433c96148fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:29.264794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd387ba4-c796-4fe2-96a3-3433c96148fe service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:29.265075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd387ba4-c796-4fe2-96a3-3433c96148fe service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:29.265347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd387ba4-c796-4fe2-96a3-3433c96148fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:29.267066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bd387ba4-c796-4fe2-96a3-3433c96148fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:29.371203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd387ba4-c796-4fe2-96a3-3433c96148fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:29.373420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd387ba4-c796-4fe2-96a3-3433c96148fe service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:29.396747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 524/1056] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:31.681041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72b81-b723-4386-bf8d-8fdbd77faff8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.681573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72b81-b723-4386-bf8d-8fdbd77faff8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.681573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a72b81-b723-4386-bf8d-8fdbd77faff8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.683018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 533/1057] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:33:31.688294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44efa-b206-4753-8684-c6c86a5daf4e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:31.688847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44efa-b206-4753-8684-c6c86a5daf4e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:31.688847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a44efa-b206-4753-8684-c6c86a5daf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:31.758549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d0a44efa-b206-4753-8684-c6c86a5daf4e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:31.759790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d0a44efa-b206-4753-8684-c6c86a5daf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:31.798768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:31.858587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 525/1058] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:32.151757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72b81-b723-4386-bf8d-8fdbd77faff8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:32.153363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-71a72b81-b723-4386-bf8d-8fdbd77faff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:32.228100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:32.314776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a72b81-b723-4386-bf8d-8fdbd77faff8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:32.430041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60109bb-8b26-4b1e-84a5-1216b1866b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:32.430566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60109bb-8b26-4b1e-84a5-1216b1866b90 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:32.430846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60109bb-8b26-4b1e-84a5-1216b1866b90 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:32.431116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60109bb-8b26-4b1e-84a5-1216b1866b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:32.432738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f60109bb-8b26-4b1e-84a5-1216b1866b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:32.453648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:32.526790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60109bb-8b26-4b1e-84a5-1216b1866b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:32.528410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60109bb-8b26-4b1e-84a5-1216b1866b90 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:32.547052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 534/1059] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:35.355124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac390d-f2f9-49a4-baae-9276e6fd255d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.355769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac390d-f2f9-49a4-baae-9276e6fd255d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.355769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac390d-f2f9-49a4-baae-9276e6fd255d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.357161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 526/1060] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:35.363311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f627-d04e-4fb4-ab35-0ec357f9d611 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:35.363761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f627-d04e-4fb4-ab35-0ec357f9d611 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:35.363881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8f627-d04e-4fb4-ab35-0ec357f9d611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:35.433101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7fc8f627-d04e-4fb4-ab35-0ec357f9d611 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:35.434220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7fc8f627-d04e-4fb4-ab35-0ec357f9d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.528012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:35.534668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 535/1061] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:35.822705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac390d-f2f9-49a4-baae-9276e6fd255d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:35.824350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7fac390d-f2f9-49a4-baae-9276e6fd255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:35.979338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac390d-f2f9-49a4-baae-9276e6fd255d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:36.001305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:36.099747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3a6d-04bf-4afa-b7a7-96f89f761ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:36.100535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3a6d-04bf-4afa-b7a7-96f89f761ff7 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:36.101182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3a6d-04bf-4afa-b7a7-96f89f761ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:36.101480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3a6d-04bf-4afa-b7a7-96f89f761ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:36.103190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9c6c3a6d-04bf-4afa-b7a7-96f89f761ff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:36.209754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3a6d-04bf-4afa-b7a7-96f89f761ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:36.211784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3a6d-04bf-4afa-b7a7-96f89f761ff7 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:36.232362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 527/1062] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:38.430116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b3ea-278b-4e79-b240-482ed0c6b511 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.430627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b3ea-278b-4e79-b240-482ed0c6b511 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.430627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b3ea-278b-4e79-b240-482ed0c6b511 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.432018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 536/1063] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:38.437610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b2743-71c3-437f-9cf4-362e44194b86 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:38.438066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b2743-71c3-437f-9cf4-362e44194b86 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:38.438217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b2743-71c3-437f-9cf4-362e44194b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:38.477071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:38.512941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-761b2743-71c3-437f-9cf4-362e44194b86 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:38.514187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-761b2743-71c3-437f-9cf4-362e44194b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:38.628480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 528/1064] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:38.918731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3b3ea-278b-4e79-b240-482ed0c6b511 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:38.920215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3cf3b3ea-278b-4e79-b240-482ed0c6b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.071234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3b3ea-278b-4e79-b240-482ed0c6b511 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.113074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47c3d6-2194-4e29-afd1-e194b7360632 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.113356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47c3d6-2194-4e29-afd1-e194b7360632 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.113626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47c3d6-2194-4e29-afd1-e194b7360632 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.115028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 529/1065] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:33:39.120105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd4da3-a1c6-443e-a43d-9b1b97e72c6e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.120387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd4da3-a1c6-443e-a43d-9b1b97e72c6e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.120698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd4da3-a1c6-443e-a43d-9b1b97e72c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.142013 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:39.189117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-40fd4da3-a1c6-443e-a43d-9b1b97e72c6e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:39.190302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-40fd4da3-a1c6-443e-a43d-9b1b97e72c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.190903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71657436-cd13-4e39-ac02-8c5303361d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.191507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657436-cd13-4e39-ac02-8c5303361d11 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.191781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657436-cd13-4e39-ac02-8c5303361d11 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.192046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71657436-cd13-4e39-ac02-8c5303361d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.193629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-71657436-cd13-4e39-ac02-8c5303361d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.244880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:39.285503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71657436-cd13-4e39-ac02-8c5303361d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:39.287094 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71657436-cd13-4e39-ac02-8c5303361d11 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:39.287891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 530/1066] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:39.305036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 537/1067] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:39.598402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564319-c5f7-48bf-ad9f-80e38f4c932b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.598930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564319-c5f7-48bf-ad9f-80e38f4c932b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.599022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564319-c5f7-48bf-ad9f-80e38f4c932b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.600389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 531/1068] 10.222.0.39 () {54 vars in 962 bytes} [Wed Nov 2 07:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:39.606126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a1fa-dc3f-43e1-a0be-e9d267aa0d40 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.606671 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a1fa-dc3f-43e1-a0be-e9d267aa0d40 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.606769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a1fa-dc3f-43e1-a0be-e9d267aa0d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.686172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0ce5a1fa-dc3f-43e1-a0be-e9d267aa0d40 None None] MFA Rules not processed for user `12ea11e310224282b38a0822fbbcf40a`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:39.687368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0ce5a1fa-dc3f-43e1-a0be-e9d267aa0d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.712049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:39.768551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 538/1069] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Nov 2 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:39.776471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564319-c5f7-48bf-ad9f-80e38f4c932b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:39.777994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ca564319-c5f7-48bf-ad9f-80e38f4c932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.896749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564319-c5f7-48bf-ad9f-80e38f4c932b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:39.978082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ea101-72a2-4ee1-9f2b-764ce6077381 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:39.978602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea101-72a2-4ee1-9f2b-764ce6077381 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:39.978880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea101-72a2-4ee1-9f2b-764ce6077381 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:39.979147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea101-72a2-4ee1-9f2b-764ce6077381 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:39.980972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-703ea101-72a2-4ee1-9f2b-764ce6077381 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:39.994038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:40.099145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea101-72a2-4ee1-9f2b-764ce6077381 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:40.100616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ea101-72a2-4ee1-9f2b-764ce6077381 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:40.126030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 532/1070] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:41.048388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b78c-ebcc-4b35-b180-0c40c29438ed None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.049492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b78c-ebcc-4b35-b180-0c40c29438ed None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.049598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b78c-ebcc-4b35-b180-0c40c29438ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.117125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cb84b78c-ebcc-4b35-b180-0c40c29438ed None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:41.118782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cb84b78c-ebcc-4b35-b180-0c40c29438ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:41.206847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 539/1071] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:33:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:41.252957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a1ea-9bdc-4837-824a-6bb33a188629 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.253429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a1ea-9bdc-4837-824a-6bb33a188629 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.253526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a1ea-9bdc-4837-824a-6bb33a188629 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.254847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 533/1072] 10.222.0.39 () {54 vars in 943 bytes} [Wed Nov 2 07:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:41.261146 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b372e-7876-4566-a8d8-0b2b93817908 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.261432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b372e-7876-4566-a8d8-0b2b93817908 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.261703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b372e-7876-4566-a8d8-0b2b93817908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.309809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:41.338756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5a5b372e-7876-4566-a8d8-0b2b93817908 None None] MFA Rules not processed for user `7037b6179bdd434db3780d97d20060bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:41.340014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5a5b372e-7876-4566-a8d8-0b2b93817908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:41.446348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 540/1073] 10.222.0.39 () {58 vars in 1040 bytes} [Wed Nov 2 07:33:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:41.455848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a1ea-9bdc-4837-824a-6bb33a188629 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:41.457448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2235a1ea-9bdc-4837-824a-6bb33a188629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:41.570076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:41.597885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a1ea-9bdc-4837-824a-6bb33a188629 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:41.707345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:41.707999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.708217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.708605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.710072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254320-4a8b-4133-a8a6-42c7b8e3641e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.710238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:41.710343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254320-4a8b-4133-a8a6-42c7b8e3641e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.710647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd254320-4a8b-4133-a8a6-42c7b8e3641e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.712159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 541/1074] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:33:41.717188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc5697-996c-4126-9cd1-e52f98bee0a1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:41.717474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc5697-996c-4126-9cd1-e52f98bee0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:41.717751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc5697-996c-4126-9cd1-e52f98bee0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:41.784331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-42fc5697-996c-4126-9cd1-e52f98bee0a1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:41.785568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-42fc5697-996c-4126-9cd1-e52f98bee0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:41.795111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:41.796720 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:41.804682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 534/1075] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:33:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:33:41.837941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:41.884695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 542/1076] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:33:42.180458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:42.180458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:42.196048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:42.281448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d88e73-38b7-42e0-b54a-60529b0e15c5 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:42.408755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44f0f2-cfbc-4538-9944-c71fdff60f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:42.409373 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f0f2-cfbc-4538-9944-c71fdff60f78 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:42.409646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f0f2-cfbc-4538-9944-c71fdff60f78 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:42.409914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f0f2-cfbc-4538-9944-c71fdff60f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:42.411535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ff44f0f2-cfbc-4538-9944-c71fdff60f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:42.451755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:42.513858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f0f2-cfbc-4538-9944-c71fdff60f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:42.515438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f0f2-cfbc-4538-9944-c71fdff60f78 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:42.537548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 535/1077] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:44.857759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a3311-299e-4130-a52f-c6658f198dbb None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:44.858303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a3311-299e-4130-a52f-c6658f198dbb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:44.858751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a3311-299e-4130-a52f-c6658f198dbb None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:44.860156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 543/1078] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:44.866720 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31c49-8dcb-4b0d-ac09-0c5a1bf67c18 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:44.867266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31c49-8dcb-4b0d-ac09-0c5a1bf67c18 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:44.867266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e31c49-8dcb-4b0d-ac09-0c5a1bf67c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:44.942185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79e31c49-8dcb-4b0d-ac09-0c5a1bf67c18 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:44.944098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79e31c49-8dcb-4b0d-ac09-0c5a1bf67c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:45.087214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 536/1079] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:45.388258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a3311-299e-4130-a52f-c6658f198dbb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:45.389883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2d3a3311-299e-4130-a52f-c6658f198dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:45.617601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a3311-299e-4130-a52f-c6658f198dbb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:45.661660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:45.763090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7a727-52d7-428f-b3a2-2715fbb4e7bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:45.764046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7a727-52d7-428f-b3a2-2715fbb4e7bf service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:45.764547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7a727-52d7-428f-b3a2-2715fbb4e7bf service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:45.765012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7a727-52d7-428f-b3a2-2715fbb4e7bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:45.766778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f4c7a727-52d7-428f-b3a2-2715fbb4e7bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:45.873828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7a727-52d7-428f-b3a2-2715fbb4e7bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:45.875411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7a727-52d7-428f-b3a2-2715fbb4e7bf service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:45.904620 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 544/1080] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:48.265377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d57af-daa9-4c56-9635-6121c6d42709 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:48.265976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d57af-daa9-4c56-9635-6121c6d42709 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:48.265976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d57af-daa9-4c56-9635-6121c6d42709 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:48.267298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 537/1081] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:48.273033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4227a6-783b-4939-9d2e-4d50ab5db86b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:48.273475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4227a6-783b-4939-9d2e-4d50ab5db86b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:48.273577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4227a6-783b-4939-9d2e-4d50ab5db86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:48.321773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:48.344702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4a4227a6-783b-4939-9d2e-4d50ab5db86b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:48.346541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4a4227a6-783b-4939-9d2e-4d50ab5db86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:48.460513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 545/1082] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:48.751240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d57af-daa9-4c56-9635-6121c6d42709 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:48.752858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-535d57af-daa9-4c56-9635-6121c6d42709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:48.762938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:48.920191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d57af-daa9-4c56-9635-6121c6d42709 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:49.006666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:49.042991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf2380-12d7-45bd-8a88-fdf59d6e7d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:49.043897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf2380-12d7-45bd-8a88-fdf59d6e7d62 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:49.044332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf2380-12d7-45bd-8a88-fdf59d6e7d62 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:49.044791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf2380-12d7-45bd-8a88-fdf59d6e7d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:49.046542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-89cf2380-12d7-45bd-8a88-fdf59d6e7d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:49.147496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf2380-12d7-45bd-8a88-fdf59d6e7d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:49.149135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf2380-12d7-45bd-8a88-fdf59d6e7d62 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:49.168194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 538/1083] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:33:51.556999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142f9a-6469-4a65-bd25-1e46e36c40b5 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:51.557603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142f9a-6469-4a65-bd25-1e46e36c40b5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:51.557603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f142f9a-6469-4a65-bd25-1e46e36c40b5 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:51.558896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 546/1084] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:33:51.564955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edc6d-3d29-48b6-bbcb-87f2cd00c129 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:51.565407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edc6d-3d29-48b6-bbcb-87f2cd00c129 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:51.565514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edc6d-3d29-48b6-bbcb-87f2cd00c129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:51.636402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-549edc6d-3d29-48b6-bbcb-87f2cd00c129 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:33:51.637673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-549edc6d-3d29-48b6-bbcb-87f2cd00c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:51.694279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:51.749426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 539/1085] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:33:52.043697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f142f9a-6469-4a65-bd25-1e46e36c40b5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:33:52.045354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1f142f9a-6469-4a65-bd25-1e46e36c40b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:52.167187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:52.208818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f142f9a-6469-4a65-bd25-1e46e36c40b5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:33:52.331020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1eeb8-79ec-4579-a0b0-9ef0e859a2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:33:52.331535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1eeb8-79ec-4579-a0b0-9ef0e859a2bb service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:33:52.331811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1eeb8-79ec-4579-a0b0-9ef0e859a2bb service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:33:52.332077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1eeb8-79ec-4579-a0b0-9ef0e859a2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:33:52.333686 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a0b1eeb8-79ec-4579-a0b0-9ef0e859a2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:33:52.418658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:33:52.433019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1eeb8-79ec-4579-a0b0-9ef0e859a2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:33:52.434693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1eeb8-79ec-4579-a0b0-9ef0e859a2bb service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:33:52.463800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 547/1086] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:01.747834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=23 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:02.450661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=11 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:05.733627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7fc4-48a2-47a5-83d9-b052cfc9cbf5 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:05.734229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7fc4-48a2-47a5-83d9-b052cfc9cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:05.734229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c7fc4-48a2-47a5-83d9-b052cfc9cbf5 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:05.735487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 540/1087] 10.222.0.39 () {54 vars in 918 bytes} [Wed Nov 2 07:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:05.740558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f067e6-bff2-4b85-bb97-3c2c60062269 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:05.740981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f067e6-bff2-4b85-bb97-3c2c60062269 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:05.741078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f067e6-bff2-4b85-bb97-3c2c60062269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:05.818920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-61f067e6-bff2-4b85-bb97-3c2c60062269 None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:05.820123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-61f067e6-bff2-4b85-bb97-3c2c60062269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:05.925203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 548/1088] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Nov 2 07:34:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:05.939186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6601c4-2283-4e27-a1e3-ce970e333786 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:05.939470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6601c4-2283-4e27-a1e3-ce970e333786 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:05.939741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6601c4-2283-4e27-a1e3-ce970e333786 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:05.941133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 541/1089] 10.222.0.39 () {54 vars in 918 bytes} [Wed Nov 2 07:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:05.945729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080e92-c1bd-421e-bc8c-8735e913eaf0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:05.946013 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080e92-c1bd-421e-bc8c-8735e913eaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:05.946281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080e92-c1bd-421e-bc8c-8735e913eaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:06.019177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:06.022129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0d080e92-c1bd-421e-bc8c-8735e913eaf0 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:06.023306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0d080e92-c1bd-421e-bc8c-8735e913eaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:06.138939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 549/1090] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Nov 2 07:34:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:08.691976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09990-7a27-45e5-9de5-6f00bb101773 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:08.692561 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09990-7a27-45e5-9de5-6f00bb101773 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:08.692561 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf09990-7a27-45e5-9de5-6f00bb101773 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:08.693886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 542/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:08.699339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc8fb5-a411-44b8-ad39-aea7e517cf07 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:08.699718 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc8fb5-a411-44b8-ad39-aea7e517cf07 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:08.699892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc8fb5-a411-44b8-ad39-aea7e517cf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:08.765374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d4fc8fb5-a411-44b8-ad39-aea7e517cf07 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:08.766571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d4fc8fb5-a411-44b8-ad39-aea7e517cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:08.821078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:08.862630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 550/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:09.150639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf09990-7a27-45e5-9de5-6f00bb101773 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:09.152149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7cf09990-7a27-45e5-9de5-6f00bb101773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:09.297203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf09990-7a27-45e5-9de5-6f00bb101773 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:09.367973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:09.407474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a8019-23e8-4679-b54d-9eb66835396b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:09.408467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8019-23e8-4679-b54d-9eb66835396b service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:09.408755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8019-23e8-4679-b54d-9eb66835396b service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:09.409219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a8019-23e8-4679-b54d-9eb66835396b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:09.411102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b42a8019-23e8-4679-b54d-9eb66835396b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:09.498274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a8019-23e8-4679-b54d-9eb66835396b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:09.499856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a8019-23e8-4679-b54d-9eb66835396b service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:09.517939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 543/1093] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:10.638865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429aa18-d5e9-4492-9f6a-411752623db0 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:10.639433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429aa18-d5e9-4492-9f6a-411752623db0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:10.639433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429aa18-d5e9-4492-9f6a-411752623db0 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:10.640778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 551/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:10.646169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79f64-11b2-4a43-88cf-70756a377b19 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:10.646634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79f64-11b2-4a43-88cf-70756a377b19 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:10.646738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79f64-11b2-4a43-88cf-70756a377b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:10.721782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-13f79f64-11b2-4a43-88cf-70756a377b19 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:10.722877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-13f79f64-11b2-4a43-88cf-70756a377b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:10.749015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:10.819588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 544/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:10.983720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429aa18-d5e9-4492-9f6a-411752623db0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:10.985276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b429aa18-d5e9-4492-9f6a-411752623db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:11.129446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429aa18-d5e9-4492-9f6a-411752623db0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:11.168901 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:11.241973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d11ec3-62b5-4e00-8cd1-91afcd062dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:11.242500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11ec3-62b5-4e00-8cd1-91afcd062dea service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:11.242775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11ec3-62b5-4e00-8cd1-91afcd062dea service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:11.243066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d11ec3-62b5-4e00-8cd1-91afcd062dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:11.244689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b6d11ec3-62b5-4e00-8cd1-91afcd062dea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:11.332583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11ec3-62b5-4e00-8cd1-91afcd062dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:11.334147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d11ec3-62b5-4e00-8cd1-91afcd062dea service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:11.351988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 552/1096] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:12.463920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299925-13c6-4fa7-a162-f64a92accbe9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:12.464456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299925-13c6-4fa7-a162-f64a92accbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:12.464456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299925-13c6-4fa7-a162-f64a92accbe9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:12.465730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 545/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:12.470481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301602-e43e-413c-aca9-2b2bfe69307a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:12.470881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301602-e43e-413c-aca9-2b2bfe69307a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:12.471088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301602-e43e-413c-aca9-2b2bfe69307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:12.524371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:12.546821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-29301602-e43e-413c-aca9-2b2bfe69307a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:12.548006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-29301602-e43e-413c-aca9-2b2bfe69307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:12.649232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 553/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:34:12.801319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299925-13c6-4fa7-a162-f64a92accbe9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:12.802825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4b299925-13c6-4fa7-a162-f64a92accbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:12.946558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299925-13c6-4fa7-a162-f64a92accbe9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:12.959045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:13.057116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d1287-1622-4808-bc8d-4104e63a51ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:13.057636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1287-1622-4808-bc8d-4104e63a51ec service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:13.057911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1287-1622-4808-bc8d-4104e63a51ec service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:13.058175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1287-1622-4808-bc8d-4104e63a51ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:13.059804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-241d1287-1622-4808-bc8d-4104e63a51ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:13.149005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d1287-1622-4808-bc8d-4104e63a51ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:13.150587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d1287-1622-4808-bc8d-4104e63a51ec service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:13.168289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 546/1099] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:34:14.265077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8768-1e56-4eee-880b-d4df431c7759 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:14.265666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8768-1e56-4eee-880b-d4df431c7759 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:14.265666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8768-1e56-4eee-880b-d4df431c7759 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:14.266963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 554/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:14.272336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36556f8-54ee-4d08-864a-1b0c77cf52a5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:14.272795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36556f8-54ee-4d08-864a-1b0c77cf52a5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:14.272909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36556f8-54ee-4d08-864a-1b0c77cf52a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:14.293235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:14.349704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a36556f8-54ee-4d08-864a-1b0c77cf52a5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:14.350893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a36556f8-54ee-4d08-864a-1b0c77cf52a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:14.444919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 547/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:14.594742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c8768-1e56-4eee-880b-d4df431c7759 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:14.596255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-647c8768-1e56-4eee-880b-d4df431c7759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:14.705398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:14.740837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c8768-1e56-4eee-880b-d4df431c7759 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:14.852755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d2b73-b76b-4843-b95a-6df7bc72e92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:14.853443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d2b73-b76b-4843-b95a-6df7bc72e92d service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:14.853719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d2b73-b76b-4843-b95a-6df7bc72e92d service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:14.853986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d2b73-b76b-4843-b95a-6df7bc72e92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:14.855559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-305d2b73-b76b-4843-b95a-6df7bc72e92d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:14.931014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:14.944735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d2b73-b76b-4843-b95a-6df7bc72e92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:14.946301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d2b73-b76b-4843-b95a-6df7bc72e92d service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:14.964629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 555/1102] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:34:16.058482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f0ac2-6c18-49ca-910b-1bf635bd2aa2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:16.059019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f0ac2-6c18-49ca-910b-1bf635bd2aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:16.059019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f0ac2-6c18-49ca-910b-1bf635bd2aa2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:16.060375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 548/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:16.065952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d0c5-bfe7-427b-ad95-b1278068533b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:16.066364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d0c5-bfe7-427b-ad95-b1278068533b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:16.066488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480d0c5-bfe7-427b-ad95-b1278068533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:16.145316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b480d0c5-bfe7-427b-ad95-b1278068533b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:16.146492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b480d0c5-bfe7-427b-ad95-b1278068533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:16.240038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 556/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:16.388804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f0ac2-6c18-49ca-910b-1bf635bd2aa2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:16.390480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-555f0ac2-6c18-49ca-910b-1bf635bd2aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:16.476318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:16.537034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f0ac2-6c18-49ca-910b-1bf635bd2aa2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:16.649376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af3400-8a77-4997-8583-5d0598605201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:16.649975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af3400-8a77-4997-8583-5d0598605201 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:16.650248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af3400-8a77-4997-8583-5d0598605201 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:16.650512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af3400-8a77-4997-8583-5d0598605201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:16.652094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-96af3400-8a77-4997-8583-5d0598605201 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:16.700717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:16.745174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af3400-8a77-4997-8583-5d0598605201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:16.746759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af3400-8a77-4997-8583-5d0598605201 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:16.764377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 549/1105] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:17.900990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d00c4-46e0-41b4-ac7f-7e220533ee61 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:17.901572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d00c4-46e0-41b4-ac7f-7e220533ee61 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:17.901572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d00c4-46e0-41b4-ac7f-7e220533ee61 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:17.902849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 557/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:17.907598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415506f9-8f94-41cc-afa7-c33d5292e2db None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:17.908326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415506f9-8f94-41cc-afa7-c33d5292e2db None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:17.908489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415506f9-8f94-41cc-afa7-c33d5292e2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:17.983504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-415506f9-8f94-41cc-afa7-c33d5292e2db None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:17.984658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-415506f9-8f94-41cc-afa7-c33d5292e2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:18.078777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 550/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:18.229336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d00c4-46e0-41b4-ac7f-7e220533ee61 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:18.230899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa3d00c4-46e0-41b4-ac7f-7e220533ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:18.279818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:18.373987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d00c4-46e0-41b4-ac7f-7e220533ee61 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:18.484754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a237446-d5e6-451d-931f-f7ff3826014f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:18.485352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a237446-d5e6-451d-931f-f7ff3826014f service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:18.485629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a237446-d5e6-451d-931f-f7ff3826014f service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:18.485896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a237446-d5e6-451d-931f-f7ff3826014f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:18.487979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6a237446-d5e6-451d-931f-f7ff3826014f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:18.494787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:18.577097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a237446-d5e6-451d-931f-f7ff3826014f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:18.578599 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a237446-d5e6-451d-931f-f7ff3826014f service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:18.595906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 558/1108] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:19.702293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f0f9-164f-4972-963f-9639a64cdeee None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:19.702764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f0f9-164f-4972-963f-9639a64cdeee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:19.702875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f0f9-164f-4972-963f-9639a64cdeee None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:19.704213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 551/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:19.709726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067082e9-b9f3-489f-9655-13527204ce31 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:19.710179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067082e9-b9f3-489f-9655-13527204ce31 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:19.710282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067082e9-b9f3-489f-9655-13527204ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:19.784390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-067082e9-b9f3-489f-9655-13527204ce31 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:19.785651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-067082e9-b9f3-489f-9655-13527204ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:19.853874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:19.882429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 559/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:20.033640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f0f9-164f-4972-963f-9639a64cdeee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:20.035090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d2a3f0f9-164f-4972-963f-9639a64cdeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:20.053359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:20.182575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f0f9-164f-4972-963f-9639a64cdeee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:20.269508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:20.294513 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f1de6-d4b2-449b-bc6d-6ee2dc039eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:20.295050 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1de6-d4b2-449b-bc6d-6ee2dc039eb8 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:20.295327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1de6-d4b2-449b-bc6d-6ee2dc039eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:20.295594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f1de6-d4b2-449b-bc6d-6ee2dc039eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:20.297194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e45f1de6-d4b2-449b-bc6d-6ee2dc039eb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:20.385310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f1de6-d4b2-449b-bc6d-6ee2dc039eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:20.386938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f1de6-d4b2-449b-bc6d-6ee2dc039eb8 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:20.404337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 552/1111] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:21.504531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1184c9-fd2b-4650-bbeb-a26020fb779a None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:21.505055 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1184c9-fd2b-4650-bbeb-a26020fb779a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:21.505055 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1184c9-fd2b-4650-bbeb-a26020fb779a None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:21.506334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 560/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:21.511367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46822d0d-4a6c-4701-9e49-3bb38cfc716a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:21.511778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46822d0d-4a6c-4701-9e49-3bb38cfc716a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:21.511914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46822d0d-4a6c-4701-9e49-3bb38cfc716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:21.586262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-46822d0d-4a6c-4701-9e49-3bb38cfc716a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:21.587460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-46822d0d-4a6c-4701-9e49-3bb38cfc716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:21.628753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:21.684985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 553/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:21.835121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1184c9-fd2b-4650-bbeb-a26020fb779a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:21.836687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ea1184c9-fd2b-4650-bbeb-a26020fb779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:21.983291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1184c9-fd2b-4650-bbeb-a26020fb779a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:22.036952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:22.094798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dc235-2f5f-4349-904f-2986f1dc8f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:22.095331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dc235-2f5f-4349-904f-2986f1dc8f73 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:22.095607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dc235-2f5f-4349-904f-2986f1dc8f73 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:22.096377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dc235-2f5f-4349-904f-2986f1dc8f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:22.097973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-810dc235-2f5f-4349-904f-2986f1dc8f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:22.187680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dc235-2f5f-4349-904f-2986f1dc8f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:22.189303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810dc235-2f5f-4349-904f-2986f1dc8f73 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:22.207409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 561/1114] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:23.286464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefaa6c-cdcb-4d3d-acfc-8593c6317260 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:23.287016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefaa6c-cdcb-4d3d-acfc-8593c6317260 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:23.287016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eefaa6c-cdcb-4d3d-acfc-8593c6317260 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:23.288380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 554/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:23.293320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8589f-1748-40b1-8dff-a984d3fa3af5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:23.293763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8589f-1748-40b1-8dff-a984d3fa3af5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:23.293862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8589f-1748-40b1-8dff-a984d3fa3af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:23.369855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-20d8589f-1748-40b1-8dff-a984d3fa3af5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:23.371038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-20d8589f-1748-40b1-8dff-a984d3fa3af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:23.373039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:23.467243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 562/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:23.616154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefaa6c-cdcb-4d3d-acfc-8593c6317260 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:23.617713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0eefaa6c-cdcb-4d3d-acfc-8593c6317260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:23.760555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eefaa6c-cdcb-4d3d-acfc-8593c6317260 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:23.786529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:23.871668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2052a-16b9-47f7-9930-904979328622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:23.872269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2052a-16b9-47f7-9930-904979328622 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:23.872574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2052a-16b9-47f7-9930-904979328622 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:23.872847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2052a-16b9-47f7-9930-904979328622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:23.874421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2cc2052a-16b9-47f7-9930-904979328622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:23.964115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2052a-16b9-47f7-9930-904979328622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:23.965750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2052a-16b9-47f7-9930-904979328622 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:23.983278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 555/1117] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:26.035810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca1c15-8018-41c0-8d46-86d11bb46879 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:26.036354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca1c15-8018-41c0-8d46-86d11bb46879 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:26.036354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca1c15-8018-41c0-8d46-86d11bb46879 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:26.041548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 563/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:26.043034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260a63-9e32-4ce4-ac42-7fd968579b83 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:26.043467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260a63-9e32-4ce4-ac42-7fd968579b83 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:26.043633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20260a63-9e32-4ce4-ac42-7fd968579b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:26.085528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:26.109730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-20260a63-9e32-4ce4-ac42-7fd968579b83 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:26.110954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-20260a63-9e32-4ce4-ac42-7fd968579b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:26.207043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 556/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:26.492494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca1c15-8018-41c0-8d46-86d11bb46879 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:26.494061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-05ca1c15-8018-41c0-8d46-86d11bb46879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:26.597748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca1c15-8018-41c0-8d46-86d11bb46879 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:26.629597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:26.671548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0a886-2d7a-4274-a25b-51015ea7710a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:26.672138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a886-2d7a-4274-a25b-51015ea7710a service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:26.672409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a886-2d7a-4274-a25b-51015ea7710a service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:26.672708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0a886-2d7a-4274-a25b-51015ea7710a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:26.674902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-67b0a886-2d7a-4274-a25b-51015ea7710a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:26.782389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a886-2d7a-4274-a25b-51015ea7710a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:26.784607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0a886-2d7a-4274-a25b-51015ea7710a service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:26.802337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 564/1120] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:29.092161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef915f-4baa-485e-850e-7ff1be5e6976 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:29.092749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef915f-4baa-485e-850e-7ff1be5e6976 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:29.092749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef915f-4baa-485e-850e-7ff1be5e6976 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:29.094101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 557/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:29.099560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94bd48-ea79-427f-999b-8965af9f6fbd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:29.100000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94bd48-ea79-427f-999b-8965af9f6fbd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:29.100105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94bd48-ea79-427f-999b-8965af9f6fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:29.165251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9b94bd48-ea79-427f-999b-8965af9f6fbd None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:29.166432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9b94bd48-ea79-427f-999b-8965af9f6fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:29.179431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:29.262293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 565/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:29.546839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef915f-4baa-485e-850e-7ff1be5e6976 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:29.548414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-29ef915f-4baa-485e-850e-7ff1be5e6976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:29.649676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef915f-4baa-485e-850e-7ff1be5e6976 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:29.662789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:29.723894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c0c9f-1c3d-480d-87f4-5ee097360afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:29.724526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c0c9f-1c3d-480d-87f4-5ee097360afe service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:29.724807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c0c9f-1c3d-480d-87f4-5ee097360afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:29.725076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c0c9f-1c3d-480d-87f4-5ee097360afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:29.726651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-172c0c9f-1c3d-480d-87f4-5ee097360afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:29.833245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c0c9f-1c3d-480d-87f4-5ee097360afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:29.834679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c0c9f-1c3d-480d-87f4-5ee097360afe service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:29.853402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 558/1123] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:32.351208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf50296-a1bf-4d61-b3f3-579e9c756b81 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:32.351736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf50296-a1bf-4d61-b3f3-579e9c756b81 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:32.351736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf50296-a1bf-4d61-b3f3-579e9c756b81 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:32.353141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 566/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:32.358284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273a8e4-311d-4bed-bd4c-5f65ffbe36f2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:32.358721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273a8e4-311d-4bed-bd4c-5f65ffbe36f2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:32.358816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273a8e4-311d-4bed-bd4c-5f65ffbe36f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:32.406846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:32.424554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6273a8e4-311d-4bed-bd4c-5f65ffbe36f2 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:32.425849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6273a8e4-311d-4bed-bd4c-5f65ffbe36f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:32.521094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 559/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:32.802531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf50296-a1bf-4d61-b3f3-579e9c756b81 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:32.804048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dcf50296-a1bf-4d61-b3f3-579e9c756b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:32.906310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf50296-a1bf-4d61-b3f3-579e9c756b81 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:32.947682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:32.980274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b4714-14c3-47df-ab95-767ce9be4470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:32.980901 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4714-14c3-47df-ab95-767ce9be4470 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:32.981179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4714-14c3-47df-ab95-767ce9be4470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:32.981445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b4714-14c3-47df-ab95-767ce9be4470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:32.983009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5d1b4714-14c3-47df-ab95-767ce9be4470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:33.090420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b4714-14c3-47df-ab95-767ce9be4470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:33.091880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b4714-14c3-47df-ab95-767ce9be4470 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:33.110335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 567/1126] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:35.378310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e354-4ba7-428f-b8b8-29ca658ce64f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:35.378868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e354-4ba7-428f-b8b8-29ca658ce64f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:35.378868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e354-4ba7-428f-b8b8-29ca658ce64f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:35.380194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 560/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:35.385565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3babc-4162-4146-a3e9-8cf86b09c97d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:35.385990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3babc-4162-4146-a3e9-8cf86b09c97d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:35.386119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3babc-4162-4146-a3e9-8cf86b09c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:35.451362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-92c3babc-4162-4146-a3e9-8cf86b09c97d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:35.452561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-92c3babc-4162-4146-a3e9-8cf86b09c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:35.473533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:35.549312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 568/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:35.831018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30e354-4ba7-428f-b8b8-29ca658ce64f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:35.832620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3a30e354-4ba7-428f-b8b8-29ca658ce64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:35.936181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30e354-4ba7-428f-b8b8-29ca658ce64f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:35.956892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:36.009549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e3f86-1ef9-4014-adc6-3cb139625672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:36.010148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e3f86-1ef9-4014-adc6-3cb139625672 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:36.010422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e3f86-1ef9-4014-adc6-3cb139625672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:36.010690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e3f86-1ef9-4014-adc6-3cb139625672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:36.012280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c34e3f86-1ef9-4014-adc6-3cb139625672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:36.120470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e3f86-1ef9-4014-adc6-3cb139625672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:36.121903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e3f86-1ef9-4014-adc6-3cb139625672 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:36.140146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 561/1129] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:38.364490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fc311-7092-4ad1-8c85-12a3f29cf5b8 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:38.365081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fc311-7092-4ad1-8c85-12a3f29cf5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:38.365081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fc311-7092-4ad1-8c85-12a3f29cf5b8 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:38.366384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 569/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:38.371578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466961-81b3-48b0-8738-6110866d48c3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:38.371995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466961-81b3-48b0-8738-6110866d48c3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:38.372132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be466961-81b3-48b0-8738-6110866d48c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:38.435289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:38.437861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-be466961-81b3-48b0-8738-6110866d48c3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:38.439584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-be466961-81b3-48b0-8738-6110866d48c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:38.536082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 562/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:38.827002 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fc311-7092-4ad1-8c85-12a3f29cf5b8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:38.828566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-253fc311-7092-4ad1-8c85-12a3f29cf5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:38.929543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fc311-7092-4ad1-8c85-12a3f29cf5b8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:38.978611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:39.002992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf6774-581b-4db7-88f8-dded6472ac03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:39.004283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6774-581b-4db7-88f8-dded6472ac03 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:39.004283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6774-581b-4db7-88f8-dded6472ac03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:39.004283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6774-581b-4db7-88f8-dded6472ac03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:39.005697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-74cf6774-581b-4db7-88f8-dded6472ac03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:39.115124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf6774-581b-4db7-88f8-dded6472ac03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:39.116581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf6774-581b-4db7-88f8-dded6472ac03 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:39.135068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 570/1132] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:41.398231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3eebb-9af5-4b92-b186-a007f8b13431 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:41.398741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3eebb-9af5-4b92-b186-a007f8b13431 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:41.398741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3eebb-9af5-4b92-b186-a007f8b13431 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:41.400018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 563/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:41.405348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f683f5-bbab-47d8-a990-ce75a803cfa7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:41.405763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f683f5-bbab-47d8-a990-ce75a803cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:41.405885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f683f5-bbab-47d8-a990-ce75a803cfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:41.471154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-07f683f5-bbab-47d8-a990-ce75a803cfa7 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:41.472349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-07f683f5-bbab-47d8-a990-ce75a803cfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:41.500952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:41.568362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 571/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:41.858710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3eebb-9af5-4b92-b186-a007f8b13431 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:41.860245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-00a3eebb-9af5-4b92-b186-a007f8b13431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:41.961507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3eebb-9af5-4b92-b186-a007f8b13431 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:41.990268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:42.034120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8b66-f35e-4937-874d-8de72c2a0090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:42.034706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8b66-f35e-4937-874d-8de72c2a0090 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:42.034978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8b66-f35e-4937-874d-8de72c2a0090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:42.035242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8b66-f35e-4937-874d-8de72c2a0090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:42.036822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7c9f8b66-f35e-4937-874d-8de72c2a0090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:42.145226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8b66-f35e-4937-874d-8de72c2a0090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:42.146702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8b66-f35e-4937-874d-8de72c2a0090 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:42.165535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 564/1135] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:44.353279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933dd6-7147-43bc-8cff-840a11adf09b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:44.353807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933dd6-7147-43bc-8cff-840a11adf09b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:44.353807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b933dd6-7147-43bc-8cff-840a11adf09b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:44.355158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 572/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:44.361195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00dc8f-883f-4a65-af22-4ead4d923d49 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:44.361607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00dc8f-883f-4a65-af22-4ead4d923d49 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:44.361725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00dc8f-883f-4a65-af22-4ead4d923d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:44.426977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8b00dc8f-883f-4a65-af22-4ead4d923d49 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:44.428134 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b00dc8f-883f-4a65-af22-4ead4d923d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:44.436202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:44.522739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 565/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:44.809902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b933dd6-7147-43bc-8cff-840a11adf09b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:44.811477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0b933dd6-7147-43bc-8cff-840a11adf09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:44.913628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b933dd6-7147-43bc-8cff-840a11adf09b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:44.967398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:44.987594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d99bd-5b62-4c76-947b-49a7b8cb1df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:44.988202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d99bd-5b62-4c76-947b-49a7b8cb1df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:44.988512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d99bd-5b62-4c76-947b-49a7b8cb1df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:44.988784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d99bd-5b62-4c76-947b-49a7b8cb1df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:44.990419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-262d99bd-5b62-4c76-947b-49a7b8cb1df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:45.098987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d99bd-5b62-4c76-947b-49a7b8cb1df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:45.100408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d99bd-5b62-4c76-947b-49a7b8cb1df8 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:45.118847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 573/1138] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:47.314090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70216954-1e8c-4495-83f6-7ae20a07aad3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:47.314657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70216954-1e8c-4495-83f6-7ae20a07aad3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:47.314657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70216954-1e8c-4495-83f6-7ae20a07aad3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:47.315959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:47.321319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899f1b4-26bf-44ca-ba4b-720195a3bb81 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:47.321710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899f1b4-26bf-44ca-ba4b-720195a3bb81 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:47.321860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899f1b4-26bf-44ca-ba4b-720195a3bb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:47.386652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b899f1b4-26bf-44ca-ba4b-720195a3bb81 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:47.387754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b899f1b4-26bf-44ca-ba4b-720195a3bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:47.426290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:47.482876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:47.769333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70216954-1e8c-4495-83f6-7ae20a07aad3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:47.770859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-70216954-1e8c-4495-83f6-7ae20a07aad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:47.872673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70216954-1e8c-4495-83f6-7ae20a07aad3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:47.910559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:47.946193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5f9e8-a2b7-4fc3-b7f6-5e67c8404a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:47.946721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5f9e8-a2b7-4fc3-b7f6-5e67c8404a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:47.946996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5f9e8-a2b7-4fc3-b7f6-5e67c8404a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:47.947264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5f9e8-a2b7-4fc3-b7f6-5e67c8404a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:47.948887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3aa5f9e8-a2b7-4fc3-b7f6-5e67c8404a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:48.056262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5f9e8-a2b7-4fc3-b7f6-5e67c8404a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:48.057755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5f9e8-a2b7-4fc3-b7f6-5e67c8404a23 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:48.075850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 567/1141] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:50.237593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b35e3-6e34-4fc3-b431-629d7ed4a592 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:50.238158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b35e3-6e34-4fc3-b431-629d7ed4a592 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:50.238158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b35e3-6e34-4fc3-b431-629d7ed4a592 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:50.239473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:50.245219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e788479-eef8-4233-aac3-262175abbe48 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:50.245623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e788479-eef8-4233-aac3-262175abbe48 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:50.245793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e788479-eef8-4233-aac3-262175abbe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:50.310270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9e788479-eef8-4233-aac3-262175abbe48 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:50.311438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9e788479-eef8-4233-aac3-262175abbe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:50.329867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:50.406825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:50.689112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b35e3-6e34-4fc3-b431-629d7ed4a592 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:50.690679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a27b35e3-6e34-4fc3-b431-629d7ed4a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:50.797097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b35e3-6e34-4fc3-b431-629d7ed4a592 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:50.867116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:50.873683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc0a06-d3a1-4727-80c7-d10035284749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:50.874285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0a06-d3a1-4727-80c7-d10035284749 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:50.874564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0a06-d3a1-4727-80c7-d10035284749 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:50.874834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0a06-d3a1-4727-80c7-d10035284749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:50.877928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fabc0a06-d3a1-4727-80c7-d10035284749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:50.987550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc0a06-d3a1-4727-80c7-d10035284749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:50.988976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc0a06-d3a1-4727-80c7-d10035284749 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:51.007406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 576/1144] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:34:53.151161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d1dd-112f-4d2c-8da4-cb55c567071a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:53.151608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d1dd-112f-4d2c-8da4-cb55c567071a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:53.151755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d1dd-112f-4d2c-8da4-cb55c567071a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:53.153073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:34:53.159309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c4a87-8b51-4acb-a1f7-d6d9dc44cb59 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:53.159727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c4a87-8b51-4acb-a1f7-d6d9dc44cb59 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:53.159856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c4a87-8b51-4acb-a1f7-d6d9dc44cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:53.224336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-886c4a87-8b51-4acb-a1f7-d6d9dc44cb59 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:34:53.225548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-886c4a87-8b51-4acb-a1f7-d6d9dc44cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.272558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:53.320668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:34:53.605672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931d1dd-112f-4d2c-8da4-cb55c567071a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:34:53.607210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1931d1dd-112f-4d2c-8da4-cb55c567071a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.710099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931d1dd-112f-4d2c-8da4-cb55c567071a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:34:53.757228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:34:53.781548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f23dc-e645-4c42-bece-d861e01330d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:34:53.782188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f23dc-e645-4c42-bece-d861e01330d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:34:53.782460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f23dc-e645-4c42-bece-d861e01330d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:34:53.782725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f23dc-e645-4c42-bece-d861e01330d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:34:53.785411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9b7f23dc-e645-4c42-bece-d861e01330d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:34:53.894013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f23dc-e645-4c42-bece-d861e01330d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:34:53.895372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f23dc-e645-4c42-bece-d861e01330d8 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:34:53.913660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 570/1147] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:03.319070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=22 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:03.911372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=66 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:13.887875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99582-cccc-430c-8b72-c272b4726bd7 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:13.888467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99582-cccc-430c-8b72-c272b4726bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:13.888467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b99582-cccc-430c-8b72-c272b4726bd7 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:13.889828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 578/1148] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:13.895766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60c28-556a-487c-9571-63b35d5b3267 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:13.896192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60c28-556a-487c-9571-63b35d5b3267 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:13.896310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60c28-556a-487c-9571-63b35d5b3267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:13.962093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-07c60c28-556a-487c-9571-63b35d5b3267 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:13.963212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-07c60c28-556a-487c-9571-63b35d5b3267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:14.058940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 571/1149] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:14.355031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f822-f1d1-45b7-8806-de8ae2f23099 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:14.355319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f822-f1d1-45b7-8806-de8ae2f23099 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:14.355592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718f822-f1d1-45b7-8806-de8ae2f23099 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:14.357028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 579/1150] 10.222.0.39 () {54 vars in 962 bytes} [Wed Nov 2 07:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:14.362553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1eb3-bb7e-4295-8a52-1ecf5942bb0e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:14.362841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1eb3-bb7e-4295-8a52-1ecf5942bb0e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:14.363117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1eb3-bb7e-4295-8a52-1ecf5942bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:14.438750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d06e1eb3-bb7e-4295-8a52-1ecf5942bb0e None None] MFA Rules not processed for user `12ea11e310224282b38a0822fbbcf40a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:14.439939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d06e1eb3-bb7e-4295-8a52-1ecf5942bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:14.460203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:14.515378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 572/1151] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Nov 2 07:35:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:35:14.523036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f822-f1d1-45b7-8806-de8ae2f23099 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:14.524645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9718f822-f1d1-45b7-8806-de8ae2f23099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:14.628256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718f822-f1d1-45b7-8806-de8ae2f23099 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:14.700245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704fc57-af9f-4166-823b-3b57f8d0c51c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:14.700872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704fc57-af9f-4166-823b-3b57f8d0c51c service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:14.701143 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704fc57-af9f-4166-823b-3b57f8d0c51c service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:14.701405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704fc57-af9f-4166-823b-3b57f8d0c51c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:14.703463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0704fc57-af9f-4166-823b-3b57f8d0c51c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:14.756613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:14.811046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704fc57-af9f-4166-823b-3b57f8d0c51c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:14.812529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704fc57-af9f-4166-823b-3b57f8d0c51c service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:14.830601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 580/1152] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:17.061133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f007-e7e7-4148-9c8e-29363dd7882d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:17.061716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f007-e7e7-4148-9c8e-29363dd7882d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:17.061716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f007-e7e7-4148-9c8e-29363dd7882d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:17.063003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 573/1153] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:17.068588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86b870-33ad-4900-83ca-3f546348201d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:17.069041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86b870-33ad-4900-83ca-3f546348201d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:17.069041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86b870-33ad-4900-83ca-3f546348201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:17.137049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ff86b870-33ad-4900-83ca-3f546348201d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:17.138251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ff86b870-33ad-4900-83ca-3f546348201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:17.232540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 581/1154] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:17.505361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f007-e7e7-4148-9c8e-29363dd7882d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:17.506927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1ea5f007-e7e7-4148-9c8e-29363dd7882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:17.631364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f007-e7e7-4148-9c8e-29363dd7882d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:17.679871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:17.724647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898b2bd-f64a-4edf-ac8a-d9f50e116360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:17.725247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898b2bd-f64a-4edf-ac8a-d9f50e116360 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:17.725522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898b2bd-f64a-4edf-ac8a-d9f50e116360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:17.725793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898b2bd-f64a-4edf-ac8a-d9f50e116360 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:17.726421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898b2bd-f64a-4edf-ac8a-d9f50e116360 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:17.727509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-2898b2bd-f64a-4edf-ac8a-d9f50e116360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:35:17.727509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:35:17.727509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:35:17.728683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898b2bd-f64a-4edf-ac8a-d9f50e116360 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:17.747652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 574/1155] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Nov 2 07:35:17 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:35:19.895865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1292f2-0d78-453e-8b25-a477635064c2 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:19.896467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1292f2-0d78-453e-8b25-a477635064c2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:19.896467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1292f2-0d78-453e-8b25-a477635064c2 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:19.897881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 582/1156] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:19.903226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ef16-e994-4f97-88b7-48c51d25d1b8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:19.903632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ef16-e994-4f97-88b7-48c51d25d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:19.903732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ef16-e994-4f97-88b7-48c51d25d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:19.971155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e000ef16-e994-4f97-88b7-48c51d25d1b8 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:19.972259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e000ef16-e994-4f97-88b7-48c51d25d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:20.067443 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 575/1157] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:20.359637 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1292f2-0d78-453e-8b25-a477635064c2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:20.361164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-be1292f2-0d78-453e-8b25-a477635064c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:20.370851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:20.508167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1292f2-0d78-453e-8b25-a477635064c2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:20.587916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:20.620300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18dc55-08bd-47a7-b356-cf02c213aca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:20.620926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18dc55-08bd-47a7-b356-cf02c213aca9 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:20.621258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18dc55-08bd-47a7-b356-cf02c213aca9 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:20.621564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18dc55-08bd-47a7-b356-cf02c213aca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:20.623177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ac18dc55-08bd-47a7-b356-cf02c213aca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:20.711994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18dc55-08bd-47a7-b356-cf02c213aca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:20.713597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18dc55-08bd-47a7-b356-cf02c213aca9 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:20.731047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 583/1158] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:23.059582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58818a33-591d-4e19-bb0c-b5d9a90a7325 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:23.062291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58818a33-591d-4e19-bb0c-b5d9a90a7325 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:23.062291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58818a33-591d-4e19-bb0c-b5d9a90a7325 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:23.062291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 576/1159] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:35:23.067501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff64d8f-19a4-4140-97cc-78b86a543fe7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:23.067905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff64d8f-19a4-4140-97cc-78b86a543fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:23.068054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff64d8f-19a4-4140-97cc-78b86a543fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:23.134174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bff64d8f-19a4-4140-97cc-78b86a543fe7 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:23.135369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bff64d8f-19a4-4140-97cc-78b86a543fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:23.180776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:23.229466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 584/1160] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:23.520161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58818a33-591d-4e19-bb0c-b5d9a90a7325 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:23.521817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-58818a33-591d-4e19-bb0c-b5d9a90a7325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:23.545780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:23.624478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58818a33-591d-4e19-bb0c-b5d9a90a7325 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:23.697090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6a0fe-c454-408e-a5c5-9c0f67eb0cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:23.697683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6a0fe-c454-408e-a5c5-9c0f67eb0cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:23.697954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6a0fe-c454-408e-a5c5-9c0f67eb0cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:23.698218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6a0fe-c454-408e-a5c5-9c0f67eb0cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:23.699787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9ac6a0fe-c454-408e-a5c5-9c0f67eb0cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:23.772109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:23.806315 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6a0fe-c454-408e-a5c5-9c0f67eb0cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:23.807741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6a0fe-c454-408e-a5c5-9c0f67eb0cf8 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:23.825640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 577/1161] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:26.020162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739b21-e333-43ce-97e7-d00bd1ac153b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:26.020730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739b21-e333-43ce-97e7-d00bd1ac153b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:26.020730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739b21-e333-43ce-97e7-d00bd1ac153b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:26.021967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 585/1162] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:26.027185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df59a4a-fb17-45f5-a39d-2a9ae4f8b538 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:26.027582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df59a4a-fb17-45f5-a39d-2a9ae4f8b538 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:26.027722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df59a4a-fb17-45f5-a39d-2a9ae4f8b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:26.093981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4df59a4a-fb17-45f5-a39d-2a9ae4f8b538 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:26.100637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4df59a4a-fb17-45f5-a39d-2a9ae4f8b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:26.190286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 578/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:26.476875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa739b21-e333-43ce-97e7-d00bd1ac153b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:26.478413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa739b21-e333-43ce-97e7-d00bd1ac153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:26.580878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa739b21-e333-43ce-97e7-d00bd1ac153b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:26.651726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:26.653177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ca4ff-88f2-4ee0-981a-66d1680b32a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:26.653769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca4ff-88f2-4ee0-981a-66d1680b32a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:26.654042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca4ff-88f2-4ee0-981a-66d1680b32a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:26.654307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ca4ff-88f2-4ee0-981a-66d1680b32a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:26.655894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-220ca4ff-88f2-4ee0-981a-66d1680b32a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:26.764912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ca4ff-88f2-4ee0-981a-66d1680b32a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:26.766339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ca4ff-88f2-4ee0-981a-66d1680b32a8 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:26.784057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 586/1164] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:29.120679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e2b93-26f5-4188-b733-dab6550df06b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:29.121213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e2b93-26f5-4188-b733-dab6550df06b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:29.121213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e2b93-26f5-4188-b733-dab6550df06b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:29.122490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 579/1165] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:29.127935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa0e6-e1d0-48ec-b1af-d541ad4dcb69 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:29.128337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa0e6-e1d0-48ec-b1af-d541ad4dcb69 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:29.128503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9baa0e6-e1d0-48ec-b1af-d541ad4dcb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:29.192650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f9baa0e6-e1d0-48ec-b1af-d541ad4dcb69 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:29.193817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f9baa0e6-e1d0-48ec-b1af-d541ad4dcb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:29.244558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:29.288007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 587/1166] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:29.576657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e2b93-26f5-4188-b733-dab6550df06b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:29.578741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-157e2b93-26f5-4188-b733-dab6550df06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:29.614433 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:29.681387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e2b93-26f5-4188-b733-dab6550df06b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:29.755577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a30ac0-e736-42bf-9474-ba9f18d38c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:29.756180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a30ac0-e736-42bf-9474-ba9f18d38c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:29.756543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a30ac0-e736-42bf-9474-ba9f18d38c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:29.756822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a30ac0-e736-42bf-9474-ba9f18d38c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:29.758460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-39a30ac0-e736-42bf-9474-ba9f18d38c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:29.837700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:29.867051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a30ac0-e736-42bf-9474-ba9f18d38c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:29.868507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a30ac0-e736-42bf-9474-ba9f18d38c62 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:29.887153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 580/1167] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:32.426480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb245746-d39a-4ec7-871a-bd10b1a2d241 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:32.427021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb245746-d39a-4ec7-871a-bd10b1a2d241 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:32.427021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb245746-d39a-4ec7-871a-bd10b1a2d241 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:32.428263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 588/1168] 10.222.0.39 () {54 vars in 927 bytes} [Wed Nov 2 07:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:35:32.433554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2aa7f-fa0c-429d-9422-9938a306b8cd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:32.433988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2aa7f-fa0c-429d-9422-9938a306b8cd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:32.434102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2aa7f-fa0c-429d-9422-9938a306b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:32.501418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-51d2aa7f-fa0c-429d-9422-9938a306b8cd None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:35:32.502601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-51d2aa7f-fa0c-429d-9422-9938a306b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:32.598471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 581/1169] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Nov 2 07:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:35:32.892883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb245746-d39a-4ec7-871a-bd10b1a2d241 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:35:32.894443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bb245746-d39a-4ec7-871a-bd10b1a2d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:32.996458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb245746-d39a-4ec7-871a-bd10b1a2d241 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:35:33.073960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc068708-5119-423a-8149-c189f71756a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:35:33.074581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068708-5119-423a-8149-c189f71756a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:35:33.074852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068708-5119-423a-8149-c189f71756a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:35:33.075115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc068708-5119-423a-8149-c189f71756a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:35:33.076726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cc068708-5119-423a-8149-c189f71756a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:35:33.085411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:33.187271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068708-5119-423a-8149-c189f71756a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:35:33.188646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc068708-5119-423a-8149-c189f71756a8 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:35:33.206028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 589/1170] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:35:42.596902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=82 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:35:43.203804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=50 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:20.168207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf408dd-67b8-44c5-9ef7-bbe60d3a3ea7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.168740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf408dd-67b8-44c5-9ef7-bbe60d3a3ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.168858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf408dd-67b8-44c5-9ef7-bbe60d3a3ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.248132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dbf408dd-67b8-44c5-9ef7-bbe60d3a3ea7 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:20.249347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dbf408dd-67b8-44c5-9ef7-bbe60d3a3ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:20.350093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 582/1171] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:20.358125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aaa59-a781-4215-92bb-83514d3aab64 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.358633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aaa59-a781-4215-92bb-83514d3aab64 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.358741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aaa59-a781-4215-92bb-83514d3aab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.378989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7b1aaa59-a781-4215-92bb-83514d3aab64 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:20.380108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7b1aaa59-a781-4215-92bb-83514d3aab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:20.389129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 590/1172] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:20.393521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf408dd-67b8-44c5-9ef7-bbe60d3a3ea7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:20.402883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf408dd-67b8-44c5-9ef7-bbe60d3a3ea7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:20.408067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:20.408690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.408970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.409241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.409882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:37:20.410184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.411187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:20.411187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:37:20.411187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:37:20.412079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.423899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 583/1173] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:37:20.433712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aaa59-a781-4215-92bb-83514d3aab64 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:20.442879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aaa59-a781-4215-92bb-83514d3aab64 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:20.447470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:20.448048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.448323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.448619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.449249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.450252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:20.450252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:37:20.450252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:37:20.451424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.548266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 591/1174] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:37:20 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:20.552543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:20.562966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c3b93-7ad6-4eb2-872a-5eef14b5fbd1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:20.612260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:20.619518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:20.620117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.620394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.625889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.625889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.625889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:20.625889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:37:20.625889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:37:20.625889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.684220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 584/1175] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:37:20 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:37:20.688335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:20.698712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e564e-5718-48d8-a8a7-0a92dbdc2f18 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:20.703192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:20.703768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.704051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.704361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.705057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.706641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.719334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 592/1176] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:37:20.723166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:20.733362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54599f80-e069-4bbd-b4f5-390d244b8414 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:20.737868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f04e3-9eda-4575-9adc-7e7662982526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:20.738449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f04e3-9eda-4575-9adc-7e7662982526 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.738723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f04e3-9eda-4575-9adc-7e7662982526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.738989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f04e3-9eda-4575-9adc-7e7662982526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.739615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f04e3-9eda-4575-9adc-7e7662982526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.741254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f04e3-9eda-4575-9adc-7e7662982526 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.754847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 585/1177] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:37:20.758717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:20.768965 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b4df4-dacb-4d94-93e1-36080f610564 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:20.773545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576fa80-e948-4851-a030-0d3fe95c2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:20.774719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fa80-e948-4851-a030-0d3fe95c2272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.774998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fa80-e948-4851-a030-0d3fe95c2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.775267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fa80-e948-4851-a030-0d3fe95c2272 admin admin] PATH_INFO: `/v3/projects/4c59e4dd033146e89c2503cb406b4a4b/users/99cede052ab3480b8794872323b5972c/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.790691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576fa80-e948-4851-a030-0d3fe95c2272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c59e4dd033146e89c2503cb406b4a4b, user_id=99cede052ab3480b8794872323b5972c, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:20.793368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576fa80-e948-4851-a030-0d3fe95c2272 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:20.861277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 593/1178] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:37:20 2022] PUT /identity/v3/projects/4c59e4dd033146e89c2503cb406b4a4b/users/99cede052ab3480b8794872323b5972c/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:20.872705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389c682-1856-4ee3-8c92-9fb86b95cb29 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.872988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389c682-1856-4ee3-8c92-9fb86b95cb29 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.873287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389c682-1856-4ee3-8c92-9fb86b95cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.900954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a389c682-1856-4ee3-8c92-9fb86b95cb29 None None] MFA Rules not processed for user `99cede052ab3480b8794872323b5972c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:20.902142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a389c682-1856-4ee3-8c92-9fb86b95cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:20.965734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 586/1179] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:37:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:20.979199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09603a-350a-47cf-b7b9-b2590b13f70e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.979521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09603a-350a-47cf-b7b9-b2590b13f70e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.979778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09603a-350a-47cf-b7b9-b2590b13f70e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:20.981236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 594/1180] 10.222.0.39 () {54 vars in 963 bytes} [Wed Nov 2 07:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:20.985846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22741ad-f7bb-4a33-a010-3caa55b357a2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:20.986131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22741ad-f7bb-4a33-a010-3caa55b357a2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:20.986406 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22741ad-f7bb-4a33-a010-3caa55b357a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:21.044945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c22741ad-f7bb-4a33-a010-3caa55b357a2 None None] MFA Rules not processed for user `32ee11e2d4324bb7a9b83c8fd2b98bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:21.046131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c22741ad-f7bb-4a33-a010-3caa55b357a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:21.120212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 587/1181] 10.222.0.39 () {58 vars in 1060 bytes} [Wed Nov 2 07:37:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:21.127727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09603a-350a-47cf-b7b9-b2590b13f70e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:21.138874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09603a-350a-47cf-b7b9-b2590b13f70e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:21.142327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:21.142905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:21.143180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:21.143447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:21.152452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:21.153867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:21.162711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 595/1182] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:21.247282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a78eb-ec90-4a89-8d9f-ef409d12254e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:21.247722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a78eb-ec90-4a89-8d9f-ef409d12254e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:21.247889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a78eb-ec90-4a89-8d9f-ef409d12254e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:21.249191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 588/1183] 10.222.0.39 () {52 vars in 830 bytes} [Wed Nov 2 07:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:37:21.252638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:21.314144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9f6d-441b-44cd-82b3-67335f43ef02 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:21.318736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:21.319348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:21.319627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:21.319896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] PATH_INFO: `/v3/users/99cede052ab3480b8794872323b5972c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:21.321547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cede052ab3480b8794872323b5972c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:21.322550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:21.322550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:37:21.322550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:37:21.323747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:21.549469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cede052ab3480b8794872323b5972c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:21.550101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cede052ab3480b8794872323b5972c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:21.574231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cede052ab3480b8794872323b5972c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:21.587760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cede052ab3480b8794872323b5972c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:21.591722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:21.683947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cede052ab3480b8794872323b5972c'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:21.690288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 596/1184] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:37:21 2022] DELETE /identity/v3/users/99cede052ab3480b8794872323b5972c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:21.695814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:21.695814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:21.695814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:21.714459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:37:21.717474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:21.724632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:21.772660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 589/1185] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:37:21.782714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:21.786514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:21.860894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd54a6c-6fad-48e1-82fd-237e5841cfef admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:21.864460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cfb03-de01-4631-8a2c-47b6608185c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:21.865059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfb03-de01-4631-8a2c-47b6608185c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:21.865333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfb03-de01-4631-8a2c-47b6608185c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:21.865598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cfb03-de01-4631-8a2c-47b6608185c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:21.874796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cfb03-de01-4631-8a2c-47b6608185c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:21.876207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cfb03-de01-4631-8a2c-47b6608185c9 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:21.885995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 597/1186] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:37:22.365668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:37:22.367205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:37:22.380365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cd2ee-f6a0-422d-ae26-30deceb5b7bf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:37:22.384491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:37:22.384660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:37:22.384872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:37:22.385146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] PATH_INFO: `/v3/projects/4c59e4dd033146e89c2503cb406b4a4b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:37:22.386932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c59e4dd033146e89c2503cb406b4a4b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:37:22.387970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:37:22.387970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:37:22.387970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:37:22.389207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:37:22.510581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c59e4dd033146e89c2503cb406b4a4b', 'request_id': 'req-e6cca14a-e859-4e95-b372-2294025127f9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:22.516741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c59e4dd033146e89c2503cb406b4a4b', 'request_id': 'req-e6cca14a-e859-4e95-b372-2294025127f9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:22.530597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c59e4dd033146e89c2503cb406b4a4b', 'request_id': 'req-e6cca14a-e859-4e95-b372-2294025127f9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:22.603159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] The token cache is being invalidate because project 4c59e4dd033146e89c2503cb406b4a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:37:22.603441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:22.604072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e6cca14a-e859-4e95-b372-2294025127f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:37:22.605700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 590/1187] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:37:22 2022] DELETE /identity/v3/projects/4c59e4dd033146e89c2503cb406b4a4b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:37:31.881358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:37:32.599511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:38:55.987899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae2301-ecc4-4395-9abd-113f65f20411 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:55.988568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae2301-ecc4-4395-9abd-113f65f20411 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:55.988568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae2301-ecc4-4395-9abd-113f65f20411 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:55.989828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 598/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:38:55.995012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c0d6d-4fac-438a-8ffc-6e5035141fb5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:55.995475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c0d6d-4fac-438a-8ffc-6e5035141fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:55.995593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c0d6d-4fac-438a-8ffc-6e5035141fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:56.016258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1a0c0d6d-4fac-438a-8ffc-6e5035141fb5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:38:56.017477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1a0c0d6d-4fac-438a-8ffc-6e5035141fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:56.075453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 591/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:38:56.231546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae2301-ecc4-4395-9abd-113f65f20411 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:38:56.235510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1eae2301-ecc4-4395-9abd-113f65f20411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:56.334639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae2301-ecc4-4395-9abd-113f65f20411 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:38:56.340643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939cdb7-68ae-4e30-b9ec-00c229381124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:38:56.341237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939cdb7-68ae-4e30-b9ec-00c229381124 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:56.341516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939cdb7-68ae-4e30-b9ec-00c229381124 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:56.341782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939cdb7-68ae-4e30-b9ec-00c229381124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:56.349675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939cdb7-68ae-4e30-b9ec-00c229381124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:38:56.351342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939cdb7-68ae-4e30-b9ec-00c229381124 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:38:56.360851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 599/1190] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:38:57.421803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c40af-ae3b-4d99-b74a-55dd93e2b4a7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:57.422337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c40af-ae3b-4d99-b74a-55dd93e2b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:57.422337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c40af-ae3b-4d99-b74a-55dd93e2b4a7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:57.423636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 592/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:38:57.428468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dbe4-b628-4c7a-881d-6ba11f4ed90d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:57.429419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dbe4-b628-4c7a-881d-6ba11f4ed90d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:57.429530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dbe4-b628-4c7a-881d-6ba11f4ed90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:57.451185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3c59dbe4-b628-4c7a-881d-6ba11f4ed90d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:38:57.452354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3c59dbe4-b628-4c7a-881d-6ba11f4ed90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:57.460675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 600/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:38:57.609680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c40af-ae3b-4d99-b74a-55dd93e2b4a7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:38:57.624397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c40af-ae3b-4d99-b74a-55dd93e2b4a7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:38:57.629758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d7840-e41e-45ee-9784-5b6cd03ecdda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:38:57.630348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d7840-e41e-45ee-9784-5b6cd03ecdda service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:57.630624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d7840-e41e-45ee-9784-5b6cd03ecdda service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:57.630891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d7840-e41e-45ee-9784-5b6cd03ecdda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:57.639379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d7840-e41e-45ee-9784-5b6cd03ecdda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:38:57.640986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d7840-e41e-45ee-9784-5b6cd03ecdda service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:38:57.650108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 593/1193] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:38:57.950837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004db81-66c2-43e2-bb21-66358558883e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:57.951054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004db81-66c2-43e2-bb21-66358558883e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:57.951297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004db81-66c2-43e2-bb21-66358558883e None None] PATH_INFO: `/v3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:57.952640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 601/1194] 10.222.0.27 () {54 vars in 925 bytes} [Wed Nov 2 07:38:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:38:57.958624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0161-13d3-4f25-833e-68c90cf97411 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:38:57.958913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0161-13d3-4f25-833e-68c90cf97411 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:38:57.959190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef0161-13d3-4f25-833e-68c90cf97411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:38:58.016093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-44ef0161-13d3-4f25-833e-68c90cf97411 None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:38:58.017323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-44ef0161-13d3-4f25-833e-68c90cf97411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:38:58.087325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 594/1195] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Nov 2 07:38:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:07.215159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5288bcf-0444-45ff-a5fe-1a3c5a8e07c9 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:07.217825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5288bcf-0444-45ff-a5fe-1a3c5a8e07c9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:07.217825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5288bcf-0444-45ff-a5fe-1a3c5a8e07c9 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:07.217825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 602/1196] 10.222.0.39 () {54 vars in 961 bytes} [Wed Nov 2 07:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:07.222106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da66f9-4a43-41b6-bd2a-ea7b19f3db0a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:07.222507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da66f9-4a43-41b6-bd2a-ea7b19f3db0a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:07.222654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da66f9-4a43-41b6-bd2a-ea7b19f3db0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:07.242456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-58da66f9-4a43-41b6-bd2a-ea7b19f3db0a None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:07.243664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-58da66f9-4a43-41b6-bd2a-ea7b19f3db0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:07.252098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 595/1197] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Nov 2 07:39:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:07.259707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5288bcf-0444-45ff-a5fe-1a3c5a8e07c9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:07.273750 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5288bcf-0444-45ff-a5fe-1a3c5a8e07c9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:07.278783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84863b-84a0-4194-84ca-c4e589d1eb0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:07.279360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84863b-84a0-4194-84ca-c4e589d1eb0c service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:07.279633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84863b-84a0-4194-84ca-c4e589d1eb0c service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:07.279900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84863b-84a0-4194-84ca-c4e589d1eb0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:07.288224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84863b-84a0-4194-84ca-c4e589d1eb0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:07.290454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84863b-84a0-4194-84ca-c4e589d1eb0c service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:07.299716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 603/1198] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:39:09.128758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5433-b862-4d15-9106-6a2301c61850 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:09.129209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5433-b862-4d15-9106-6a2301c61850 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:09.129307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5433-b862-4d15-9106-6a2301c61850 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:09.130637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 596/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:09.135979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150b51-01b3-4fbb-8b71-b9734ac0acda None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:09.136373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150b51-01b3-4fbb-8b71-b9734ac0acda None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:09.136562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150b51-01b3-4fbb-8b71-b9734ac0acda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:09.155945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c5150b51-01b3-4fbb-8b71-b9734ac0acda None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:09.157418 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c5150b51-01b3-4fbb-8b71-b9734ac0acda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:09.165122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 604/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:09.317904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5433-b862-4d15-9106-6a2301c61850 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:09.332625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5433-b862-4d15-9106-6a2301c61850 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:09.340120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536cc08-4c2f-430c-9607-8ee3cae2e71b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:09.340120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536cc08-4c2f-430c-9607-8ee3cae2e71b service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:09.340120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536cc08-4c2f-430c-9607-8ee3cae2e71b service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:09.340120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536cc08-4c2f-430c-9607-8ee3cae2e71b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:09.347534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536cc08-4c2f-430c-9607-8ee3cae2e71b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:09.349160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536cc08-4c2f-430c-9607-8ee3cae2e71b service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:09.358418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 597/1201] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:10.434385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5bc8-1307-4cc3-a3a9-6310e027e588 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:10.434932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5bc8-1307-4cc3-a3a9-6310e027e588 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:10.434932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f5bc8-1307-4cc3-a3a9-6310e027e588 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:10.436242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 605/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 07:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:10.441097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d381-4c64-4afa-a290-587fa1916272 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:10.441503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d381-4c64-4afa-a290-587fa1916272 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:10.441647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d381-4c64-4afa-a290-587fa1916272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:10.461669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9157d381-4c64-4afa-a290-587fa1916272 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:10.462861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9157d381-4c64-4afa-a290-587fa1916272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:10.470691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 598/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 07:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:39:10.630185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f5bc8-1307-4cc3-a3a9-6310e027e588 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:10.644404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f5bc8-1307-4cc3-a3a9-6310e027e588 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:10.649737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c2453-e6a0-44ff-896f-66a4984f9ca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:10.650296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2453-e6a0-44ff-896f-66a4984f9ca4 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:10.650579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2453-e6a0-44ff-896f-66a4984f9ca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:10.650844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2453-e6a0-44ff-896f-66a4984f9ca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:10.658877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2453-e6a0-44ff-896f-66a4984f9ca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:10.660455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c2453-e6a0-44ff-896f-66a4984f9ca4 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:10.670012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 606/1204] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:14.698824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5ae85-246b-4138-b91e-ac11ef176b35 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:14.699411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5ae85-246b-4138-b91e-ac11ef176b35 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:14.699411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5ae85-246b-4138-b91e-ac11ef176b35 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:14.700823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 599/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:14.706068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb468-dea2-4410-a5d7-c6671db2e1b6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:14.706525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb468-dea2-4410-a5d7-c6671db2e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:14.706638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb468-dea2-4410-a5d7-c6671db2e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:14.726072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-799cb468-dea2-4410-a5d7-c6671db2e1b6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:14.727255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-799cb468-dea2-4410-a5d7-c6671db2e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:14.735003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 607/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:15.025836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5ae85-246b-4138-b91e-ac11ef176b35 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:15.027566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dfe5ae85-246b-4138-b91e-ac11ef176b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:15.057013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:15.085251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5ae85-246b-4138-b91e-ac11ef176b35 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:15.089199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45632-3c56-4271-9669-c0bb6fd3dd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:15.093524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45632-3c56-4271-9669-c0bb6fd3dd04 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:15.093524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45632-3c56-4271-9669-c0bb6fd3dd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:15.093524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45632-3c56-4271-9669-c0bb6fd3dd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:15.098937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b45632-3c56-4271-9669-c0bb6fd3dd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:15.100401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b45632-3c56-4271-9669-c0bb6fd3dd04 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:15.110140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 600/1207] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:17.256389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e98f-87ad-4d95-baba-f2d1d9fdb8ec None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:17.257018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e98f-87ad-4d95-baba-f2d1d9fdb8ec None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:17.257018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e98f-87ad-4d95-baba-f2d1d9fdb8ec None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:17.258348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 608/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:17.263583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9db4d-7a1e-4ec0-8dc1-d99296838fda None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:17.264058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9db4d-7a1e-4ec0-8dc1-d99296838fda None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:17.264158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9db4d-7a1e-4ec0-8dc1-d99296838fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:17.283905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-01b9db4d-7a1e-4ec0-8dc1-d99296838fda None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:17.285106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-01b9db4d-7a1e-4ec0-8dc1-d99296838fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:17.293358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 601/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:17.577880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e98f-87ad-4d95-baba-f2d1d9fdb8ec None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:17.589212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e98f-87ad-4d95-baba-f2d1d9fdb8ec None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:17.592622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19223c-9701-4c8f-9715-203de2820ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:17.593197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19223c-9701-4c8f-9715-203de2820ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:17.593467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19223c-9701-4c8f-9715-203de2820ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:17.593730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19223c-9701-4c8f-9715-203de2820ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:17.602226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19223c-9701-4c8f-9715-203de2820ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:17.603622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19223c-9701-4c8f-9715-203de2820ba1 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:17.612614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 609/1210] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:21.488111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c80e-c332-428e-a970-5315cb515504 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:21.488653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c80e-c332-428e-a970-5315cb515504 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:21.488653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c80e-c332-428e-a970-5315cb515504 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:21.490042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 602/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:21.495719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fc333-d758-4083-8331-c45929217225 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:21.496144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fc333-d758-4083-8331-c45929217225 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:21.496259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fc333-d758-4083-8331-c45929217225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:21.515950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c37fc333-d758-4083-8331-c45929217225 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:21.517160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c37fc333-d758-4083-8331-c45929217225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:21.524933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 610/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:21.822130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c80e-c332-428e-a970-5315cb515504 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:21.823775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-06f7c80e-c332-428e-a970-5315cb515504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:21.881268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c80e-c332-428e-a970-5315cb515504 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:21.884845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9605c2-c25d-4ee9-9696-35293cdcf015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:21.885445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9605c2-c25d-4ee9-9696-35293cdcf015 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:21.885725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9605c2-c25d-4ee9-9696-35293cdcf015 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:21.885996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9605c2-c25d-4ee9-9696-35293cdcf015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:21.894768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9605c2-c25d-4ee9-9696-35293cdcf015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:21.896194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9605c2-c25d-4ee9-9696-35293cdcf015 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:21.905413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 603/1213] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:24.019988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffab8-df95-4e59-8979-a2d1867ddd50 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:24.020569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffab8-df95-4e59-8979-a2d1867ddd50 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:24.020569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffab8-df95-4e59-8979-a2d1867ddd50 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:24.022512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 611/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 07:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:39:24.027779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eaad6-19f7-4e37-bef0-0704c700e748 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:24.028199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eaad6-19f7-4e37-bef0-0704c700e748 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:24.028345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eaad6-19f7-4e37-bef0-0704c700e748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:24.048423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-065eaad6-19f7-4e37-bef0-0704c700e748 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:39:24.049649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-065eaad6-19f7-4e37-bef0-0704c700e748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:24.057485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 604/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 07:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:39:24.375763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffab8-df95-4e59-8979-a2d1867ddd50 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:39:24.377504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c1cffab8-df95-4e59-8979-a2d1867ddd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:39:24.385634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=77 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:24.391383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffab8-df95-4e59-8979-a2d1867ddd50 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:39:24.394972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098f789-4094-439c-ae84-d18faee6c0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:39:24.396535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098f789-4094-439c-ae84-d18faee6c0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:39:24.396535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098f789-4094-439c-ae84-d18faee6c0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:39:24.396535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098f789-4094-439c-ae84-d18faee6c0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:39:24.405521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098f789-4094-439c-ae84-d18faee6c0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:39:24.407176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098f789-4094-439c-ae84-d18faee6c0b9 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:39:24.416611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 612/1216] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:39:34.043204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=47 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:39:34.417410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:01.510959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab06f6-66d6-4078-bc79-489e505c289a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.511580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab06f6-66d6-4078-bc79-489e505c289a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.511580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab06f6-66d6-4078-bc79-489e505c289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.534231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-27ab06f6-66d6-4078-bc79-489e505c289a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.535978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-27ab06f6-66d6-4078-bc79-489e505c289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.546926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 605/1217] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:01.558353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49f33-6723-408b-8fa0-573dba8d0943 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.558912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49f33-6723-408b-8fa0-573dba8d0943 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.558912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49f33-6723-408b-8fa0-573dba8d0943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.586393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d3f49f33-6723-408b-8fa0-573dba8d0943 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.587619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d3f49f33-6723-408b-8fa0-573dba8d0943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.600281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 613/1218] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:01.606192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab06f6-66d6-4078-bc79-489e505c289a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.620867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab06f6-66d6-4078-bc79-489e505c289a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.630645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.631274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.631553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.631820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.632495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:01.632801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.634467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.645867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dcdbd-320c-4da2-b5fa-203a98f61b24 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.646293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dcdbd-320c-4da2-b5fa-203a98f61b24 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.646663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dcdbd-320c-4da2-b5fa-203a98f61b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.652653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 606/1219] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:41:01.679299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.679533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ea8dcdbd-320c-4da2-b5fa-203a98f61b24 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.681460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ea8dcdbd-320c-4da2-b5fa-203a98f61b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.693342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1f750-e736-4e9a-9a48-1e350f9627c6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.700871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 614/1220] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 02 07:41:01.710289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.711991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.712513 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.712642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29d716-80d5-47de-aca8-b54030736b4f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.712897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29d716-80d5-47de-aca8-b54030736b4f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.713292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29d716-80d5-47de-aca8-b54030736b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.713605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.714473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.715701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:01.715701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:41:01.715701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:41:01.717432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.747204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ba29d716-80d5-47de-aca8-b54030736b4f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:01.748422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ba29d716-80d5-47de-aca8-b54030736b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:01.763869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 615/1221] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:01.768590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29d716-80d5-47de-aca8-b54030736b4f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.779323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29d716-80d5-47de-aca8-b54030736b4f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.788932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.790134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.790421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.790693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.791370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:01.791673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.792726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:01.792726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:41:01.792726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:41:01.797067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.812578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 616/1222] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:41:01.817387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.829003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a749f8-2441-4dc4-8e85-abe3105da219 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.839315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:01.839950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:01.840249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:01.840530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:01.841187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:01.843127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:01.878161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 607/1223] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:01.889555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:01.972195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4d5d4-c2de-412d-8360-59da20f033cc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:01.975014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 617/1224] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:01.980408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.066663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f37b-402f-4cb3-b367-90c2ee35be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.067202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f37b-402f-4cb3-b367-90c2ee35be8d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.067478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f37b-402f-4cb3-b367-90c2ee35be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.068248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f37b-402f-4cb3-b367-90c2ee35be8d admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.068915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f37b-402f-4cb3-b367-90c2ee35be8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.079331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f37b-402f-4cb3-b367-90c2ee35be8d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.121784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a269b-525f-4402-ad67-0dbcc76f70ab admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.130641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.130641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.130641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.131040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.136303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.136303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:02.136303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:41:02.136303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:41:02.136303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.212012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 608/1225] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.213857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70f5c-aed6-44b2-8d86-ff855e76ee7d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.218056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70f5c-aed6-44b2-8d86-ff855e76ee7d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.218056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70f5c-aed6-44b2-8d86-ff855e76ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.251651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 618/1226] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:01 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:02.252541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.261663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9bd70f5c-aed6-44b2-8d86-ff855e76ee7d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.262879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9bd70f5c-aed6-44b2-8d86-ff855e76ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.270690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e9bef-a3a0-4943-b178-83cedef4282f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.279884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 609/1227] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.281582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd70f5c-aed6-44b2-8d86-ff855e76ee7d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.286855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393245-8417-4c35-9622-0f92461eb8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.286855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393245-8417-4c35-9622-0f92461eb8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.286855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393245-8417-4c35-9622-0f92461eb8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.286855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393245-8417-4c35-9622-0f92461eb8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.287269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393245-8417-4c35-9622-0f92461eb8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.287685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393245-8417-4c35-9622-0f92461eb8ae admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.292839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd70f5c-aed6-44b2-8d86-ff855e76ee7d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.303228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97d9c6-89e2-4b19-922f-c70d9c63908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.303848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d9c6-89e2-4b19-922f-c70d9c63908a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.304149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d9c6-89e2-4b19-922f-c70d9c63908a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.304425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d9c6-89e2-4b19-922f-c70d9c63908a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.305266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d9c6-89e2-4b19-922f-c70d9c63908a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.307148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d9c6-89e2-4b19-922f-c70d9c63908a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.309370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 619/1228] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.310976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca558-5564-4f3f-b491-0bd063f94642 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.311265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca558-5564-4f3f-b491-0bd063f94642 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.311536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca558-5564-4f3f-b491-0bd063f94642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.333426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 610/1229] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.333426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ee16-96b4-4d30-a66c-4c765904e843 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.333426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ee16-96b4-4d30-a66c-4c765904e843 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.333426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ee16-96b4-4d30-a66c-4c765904e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.345750 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c93ca558-5564-4f3f-b491-0bd063f94642 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.346928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c93ca558-5564-4f3f-b491-0bd063f94642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.353145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9373ee16-96b4-4d30-a66c-4c765904e843 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.354441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9373ee16-96b4-4d30-a66c-4c765904e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.360543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 620/1230] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.360543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0478-4756-4c71-8bc4-cc62d82043bb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.360543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0478-4756-4c71-8bc4-cc62d82043bb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.360543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c0478-4756-4c71-8bc4-cc62d82043bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.368018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 611/1231] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.369179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ee16-96b4-4d30-a66c-4c765904e843 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.379718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ee16-96b4-4d30-a66c-4c765904e843 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.381050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3f2c0478-4756-4c71-8bc4-cc62d82043bb None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.382311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3f2c0478-4756-4c71-8bc4-cc62d82043bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.385109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df10469-33a9-4a82-825d-ccf0341c2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.385706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df10469-33a9-4a82-825d-ccf0341c2772 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.385984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df10469-33a9-4a82-825d-ccf0341c2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.386255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df10469-33a9-4a82-825d-ccf0341c2772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.386896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df10469-33a9-4a82-825d-ccf0341c2772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.388610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df10469-33a9-4a82-825d-ccf0341c2772 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.391470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 621/1232] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.393864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe360c-ada6-4cf9-a965-966ba847e5f2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.395077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe360c-ada6-4cf9-a965-966ba847e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.395558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe360c-ada6-4cf9-a965-966ba847e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.400338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 612/1233] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.401643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00488f-2aef-4b73-9361-9c70c96659fb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.403298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00488f-2aef-4b73-9361-9c70c96659fb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.403298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00488f-2aef-4b73-9361-9c70c96659fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.421476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0a00488f-2aef-4b73-9361-9c70c96659fb None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.422104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-aefe360c-ada6-4cf9-a965-966ba847e5f2 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.422681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a00488f-2aef-4b73-9361-9c70c96659fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.424057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-aefe360c-ada6-4cf9-a965-966ba847e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.431152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 613/1234] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.431996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00488f-2aef-4b73-9361-9c70c96659fb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.441438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 622/1235] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.441799 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00488f-2aef-4b73-9361-9c70c96659fb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.442986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec029-ee64-45e5-9a62-a13c1e19f534 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.443330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec029-ee64-45e5-9a62-a13c1e19f534 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.443607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ec029-ee64-45e5-9a62-a13c1e19f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.447325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663e339-abd4-4013-a583-48d1592abe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.448319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e339-abd4-4013-a583-48d1592abe84 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.448841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e339-abd4-4013-a583-48d1592abe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.449254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663e339-abd4-4013-a583-48d1592abe84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.450063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e339-abd4-4013-a583-48d1592abe84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.451937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663e339-abd4-4013-a583-48d1592abe84 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.462962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 614/1236] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:02.464163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642427-258a-4dd9-adb1-f10a9d4af7bc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.464465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642427-258a-4dd9-adb1-f10a9d4af7bc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.464740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642427-258a-4dd9-adb1-f10a9d4af7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.464862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-019ec029-ee64-45e5-9a62-a13c1e19f534 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.466027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-019ec029-ee64-45e5-9a62-a13c1e19f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.472206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:02.474401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 623/1237] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.475456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec029-ee64-45e5-9a62-a13c1e19f534 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.484491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ec029-ee64-45e5-9a62-a13c1e19f534 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.484810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-18642427-258a-4dd9-adb1-f10a9d4af7bc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.486040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-18642427-258a-4dd9-adb1-f10a9d4af7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.488946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46096b66-99f7-4f98-9b2b-a0789e0e09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.489546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096b66-99f7-4f98-9b2b-a0789e0e09f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.489805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096b66-99f7-4f98-9b2b-a0789e0e09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.490071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46096b66-99f7-4f98-9b2b-a0789e0e09f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.490728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46096b66-99f7-4f98-9b2b-a0789e0e09f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:02.491024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46096b66-99f7-4f98-9b2b-a0789e0e09f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.493185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46096b66-99f7-4f98-9b2b-a0789e0e09f6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.494667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 615/1238] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.495417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18642427-258a-4dd9-adb1-f10a9d4af7bc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.505681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18642427-258a-4dd9-adb1-f10a9d4af7bc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.506296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 624/1239] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:02.509789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab22d8-6ccd-47db-b586-73d6c6fd338a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.509789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab22d8-6ccd-47db-b586-73d6c6fd338a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.509789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab22d8-6ccd-47db-b586-73d6c6fd338a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.512796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.513988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.514417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.514972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] PATH_INFO: `/v3/projects/ac4f8b9a762e453491cc427d4dbf0627/users/d02758a7cddc4e97948d2bd1558ed597/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.528764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e2ab22d8-6ccd-47db-b586-73d6c6fd338a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.529947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e2ab22d8-6ccd-47db-b586-73d6c6fd338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.536646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4f8b9a762e453491cc427d4dbf0627, user_id=d02758a7cddc4e97948d2bd1558ed597, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.540235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.541737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 625/1240] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.542863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522d06-6927-45eb-9ff1-c532ea9ef502 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.543139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522d06-6927-45eb-9ff1-c532ea9ef502 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.543409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7522d06-6927-45eb-9ff1-c532ea9ef502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.562110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e7522d06-6927-45eb-9ff1-c532ea9ef502 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.563271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e7522d06-6927-45eb-9ff1-c532ea9ef502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.571382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 626/1241] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.572575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c6be-5e42-4374-8909-594736ac769f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.572887 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c6be-5e42-4374-8909-594736ac769f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.573169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c6be-5e42-4374-8909-594736ac769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.592148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1565c6be-5e42-4374-8909-594736ac769f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.593338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1565c6be-5e42-4374-8909-594736ac769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.597552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 616/1242] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:02 2022] PUT /identity/v3/projects/ac4f8b9a762e453491cc427d4dbf0627/users/d02758a7cddc4e97948d2bd1558ed597/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:02.598341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.628507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:02.660424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b372a-95a7-48e2-91de-e81b2ed258f2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.661338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 627/1243] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.665612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565c6be-5e42-4374-8909-594736ac769f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.669163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672052-8dc8-4054-907a-8978c5007d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.669827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672052-8dc8-4054-907a-8978c5007d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.670103 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672052-8dc8-4054-907a-8978c5007d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.670372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672052-8dc8-4054-907a-8978c5007d71 admin admin] PATH_INFO: `/v3/projects/b3225bb01e8c4b2aa7225739b3f25a8d/users/207560d0ab0b4fe0bae750ac180f37bf/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.671526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565c6be-5e42-4374-8909-594736ac769f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.676078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.676692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.676972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.677243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.677883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:02.678188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.679775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.685152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672052-8dc8-4054-907a-8978c5007d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3225bb01e8c4b2aa7225739b3f25a8d, user_id=207560d0ab0b4fe0bae750ac180f37bf, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.687836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672052-8dc8-4054-907a-8978c5007d71 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.698119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 628/1244] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:02.698119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.701354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34831303-0196-4040-a518-ad076a6128fd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.706421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.707037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.707312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.718164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.718164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:02.718164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.718164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.722181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 629/1245] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:02.722923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.732445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada189f-b939-4be7-a050-d34411642a22 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.736882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.737425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.737698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.737960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.738549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.740369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.778682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 617/1246] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:02 2022] PUT /identity/v3/projects/b3225bb01e8c4b2aa7225739b3f25a8d/users/207560d0ab0b4fe0bae750ac180f37bf/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:02.779934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845abf5-a484-46bb-8ca8-826aa4ba5da9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.780240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845abf5-a484-46bb-8ca8-826aa4ba5da9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.780833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845abf5-a484-46bb-8ca8-826aa4ba5da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.799989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d845abf5-a484-46bb-8ca8-826aa4ba5da9 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.801319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d845abf5-a484-46bb-8ca8-826aa4ba5da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.856762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 630/1247] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:02.857504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.860575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 618/1248] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.861882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d9b0-c8a8-4063-8767-8ea5a53c6cc9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.862172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d9b0-c8a8-4063-8767-8ea5a53c6cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.862448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d9b0-c8a8-4063-8767-8ea5a53c6cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.891996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1143d9b0-c8a8-4063-8767-8ea5a53c6cc9 None None] MFA Rules not processed for user `d02758a7cddc4e97948d2bd1558ed597`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:02.893240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1143d9b0-c8a8-4063-8767-8ea5a53c6cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:02.921117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb6ab-b800-46df-a04b-d2dcb4255a9b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.926377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.926973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.927264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.930203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.930203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:02.930203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.930203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.938178 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:02.941390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 631/1249] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:02.942330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.953177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e09d8-d824-4c40-b418-b6065543291d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.957897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.958480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.958751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.959016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.959710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:02.960004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.961837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 619/1250] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:02.962771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d9b0-c8a8-4063-8767-8ea5a53c6cc9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.966848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.973021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d9b0-c8a8-4063-8767-8ea5a53c6cc9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.979213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb2651-6ecc-4ba9-87c5-0fc1a83654f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.979474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb2651-6ecc-4ba9-87c5-0fc1a83654f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.979753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb2651-6ecc-4ba9-87c5-0fc1a83654f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.979944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 632/1251] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:02.980331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb2651-6ecc-4ba9-87c5-0fc1a83654f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.980771 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:02.981207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb2651-6ecc-4ba9-87c5-0fc1a83654f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.983119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb2651-6ecc-4ba9-87c5-0fc1a83654f9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:02.991070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fc077-f66a-4be3-b874-33fb6186e539 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:02.995955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:02.996583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:02.999212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:02.999212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:02.999212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:02.999647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.078759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 620/1252] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.080010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102a62-8a5c-455f-8c88-2f7e58471cec None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.080286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102a62-8a5c-455f-8c88-2f7e58471cec None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.080580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32102a62-8a5c-455f-8c88-2f7e58471cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.099179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-32102a62-8a5c-455f-8c88-2f7e58471cec None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:03.100368 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-32102a62-8a5c-455f-8c88-2f7e58471cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:03.112794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 633/1253] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:02 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.112794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.159799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:03.166272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 621/1254] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:03.167138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102a62-8a5c-455f-8c88-2f7e58471cec None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.176560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32102a62-8a5c-455f-8c88-2f7e58471cec None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.178072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cf9b9-4bd2-46a4-8ee1-3882ba673f12 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.181657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.187390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.187390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.187390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.187690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.187811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:03.187909 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.187999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.188085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.188085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.188085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.188373 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.188527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.204455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 622/1255] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:03.204455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.214503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca997ef-8644-4ba4-81b3-ed3d90775cef admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.219007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37a08b-baa3-4fbc-937c-e3f16dc48fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.219588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37a08b-baa3-4fbc-937c-e3f16dc48fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.220123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37a08b-baa3-4fbc-937c-e3f16dc48fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.220394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37a08b-baa3-4fbc-937c-e3f16dc48fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.221037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37a08b-baa3-4fbc-937c-e3f16dc48fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.222951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37a08b-baa3-4fbc-937c-e3f16dc48fe5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.295668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 634/1256] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.295668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.302450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa187d4-6951-4224-90a8-f3a014387f7e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.307439 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.308031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.308306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.308601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.309204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.311078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.326041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 623/1257] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.326041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9076a86-a35f-47ca-abff-8b33e069f47e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.326041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9076a86-a35f-47ca-abff-8b33e069f47e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.326041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9076a86-a35f-47ca-abff-8b33e069f47e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.326504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 624/1258] 10.222.0.39 () {54 vars in 961 bytes} [Wed Nov 2 07:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:03.327046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9076a86-a35f-47ca-abff-8b33e069f47e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.389449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9076a86-a35f-47ca-abff-8b33e069f47e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.393849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.394429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.394706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.394970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.395616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.397562 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.433118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 635/1259] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.434074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.495248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d12216-56ed-4c90-a367-ad639f6cf214 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.499775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.500361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.500667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.500936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.501576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.503475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.529643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 625/1260] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/users => generated 282 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.534137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.549784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:03.584533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9efb-6c24-4112-aee6-2056d528128e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.604039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 636/1261] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.604039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.611241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26613b7-1f6b-4cb9-b2b4-28b080431155 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.615754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a98205-2733-4518-bcf6-b68b38c2e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.616333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a98205-2733-4518-bcf6-b68b38c2e015 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.616698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a98205-2733-4518-bcf6-b68b38c2e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.616914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a98205-2733-4518-bcf6-b68b38c2e015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.618126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a98205-2733-4518-bcf6-b68b38c2e015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.620022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a98205-2733-4518-bcf6-b68b38c2e015 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.634612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.635225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.635502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.635778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.644876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.646237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.655622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 626/1262] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:03.663049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.666122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d98b8e-dce6-4539-bced-175cfa252afe service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.670669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.671242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.671518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.671786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.672405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.674004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.685203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 627/1263] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:03.688387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.695514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bac905-098c-4730-9c74-70e33b35b053 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.700017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.700609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.700886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.701152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.701751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.703614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.713820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 637/1264] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.713820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24aa4-7fa7-4e2e-893e-c5eb27c63747 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.716535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24aa4-7fa7-4e2e-893e-c5eb27c63747 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.716535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24aa4-7fa7-4e2e-893e-c5eb27c63747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.753700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f6c24aa4-7fa7-4e2e-893e-c5eb27c63747 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:03.754895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f6c24aa4-7fa7-4e2e-893e-c5eb27c63747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:03.810808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:03.824259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 628/1265] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:03.824259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.827574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 638/1266] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:03.828461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24aa4-7fa7-4e2e-893e-c5eb27c63747 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.842740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063752b-3515-4f70-9b9c-14127dc022c7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.893481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c24aa4-7fa7-4e2e-893e-c5eb27c63747 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.898951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.899564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.899841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.900113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.900793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.901232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.901840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.902119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.902386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.902480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.903009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.905041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.912889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 639/1267] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:03.917280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.928568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01af19b-c245-4f7e-a44c-ade351c6732c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.937742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.937742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.937742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.937742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.938339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.938339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.947958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 640/1268] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:03.948637 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.958625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ee03-c42e-40ab-b8ed-8ec5892b8c83 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.975931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:03.975931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:03.975931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:03.975931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:03.976261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:03.976261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:03.981538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 641/1269] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:03.984261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:03.994048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bceae2-5ec5-47de-af9d-b2a0c25916d0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:03.998731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.001007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.001007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.001007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.001007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.002377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.028476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 629/1270] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:04.028476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.038429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d8294-3732-4a69-893c-10713ec6d251 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.043677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.044257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.044558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.044834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.045490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.047114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.057553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 630/1271] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.058387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.070119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8547ee-bd39-45aa-9cfb-12ff94bd60eb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.075636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.076191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.076496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.076768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.088277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 642/1272] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:03 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:04.088277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.097957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13373c8-3bf6-4784-9dad-38d8ba680afe admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.103210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.103789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.104064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.104357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.105019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.105400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:04.106879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.121192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 643/1273] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.121192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.131483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5464fd8-5247-41ad-a820-a077d7f18b97 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.136144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.136762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.137038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.137307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.137933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.139512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.140371 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.142103 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.153508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 644/1274] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.153508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.153701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 631/1275] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:04.153701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.165729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95965d7b-10de-44a4-bbf1-2306d3ee7b41 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.170844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.171617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.172140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.174367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.175372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.177429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.182770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cd936-4e0c-492d-b080-4974679bd63f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.188314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.189008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.189298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.189603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] PATH_INFO: `/v3/projects/6c60874767e8497897d69550d1abc342/users/a124ce6488f94a84a725330c79199df2/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.191586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 632/1276] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.192613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.202866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97411-c70c-434f-aed7-05903685d017 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.208239 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.209048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.209528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.209971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.210788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.213934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.217539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c60874767e8497897d69550d1abc342, user_id=a124ce6488f94a84a725330c79199df2, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.221417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.231666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 633/1277] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.233095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.245565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aaa97-b9ac-4f06-b3c7-a540c89a0f76 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.251032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.257603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.257603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.257603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.257603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.257603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.268631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 634/1278] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.269488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.279824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23071114-a420-4a0c-977d-c355ba09dcba admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.284638 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.285308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.290628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.290628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] PATH_INFO: `/v3/projects/8349176e48bc45d79ee52f133f9541c9/users/54796ad6bde2408db66e0802605b8efa/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.301062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8349176e48bc45d79ee52f133f9541c9, user_id=54796ad6bde2408db66e0802605b8efa, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.303790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.375190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 645/1279] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/6c60874767e8497897d69550d1abc342/users/a124ce6488f94a84a725330c79199df2/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:04.378863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.413278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 635/1280] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/8349176e48bc45d79ee52f133f9541c9/users/54796ad6bde2408db66e0802605b8efa/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:04.415151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.442538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6318e5-2e0d-46f2-9058-b696a4b5aed2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.452666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:04.498767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fc0cd-719c-46a7-8133-f5c590fe41aa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.504824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.505512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.505981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.506463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.507047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.507299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.507910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.508223 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.508517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] PATH_INFO: `/v3/projects/bdf3227ff2d243059363c56af7f0fa83/users/8b776d8c840b4b45b162c302d7cd7234/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.509492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.526053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 636/1281] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.526275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf3227ff2d243059363c56af7f0fa83, user_id=8b776d8c840b4b45b162c302d7cd7234, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.526379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.526699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.537729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49502064-1a3a-4821-ad06-004849904080 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.544175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6cb28-6aa1-4ee7-b73a-c0f94c31eace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.545013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cb28-6aa1-4ee7-b73a-c0f94c31eace admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.545357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cb28-6aa1-4ee7-b73a-c0f94c31eace admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.545707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cb28-6aa1-4ee7-b73a-c0f94c31eace admin admin] PATH_INFO: `/v3/projects/3312b317832c42c9b0a097fd4c3c0498/users/6db9f53e5e204abfb8f89a041b8c26a9/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.567623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6cb28-6aa1-4ee7-b73a-c0f94c31eace admin admin] RBAC: Authorizing `identity:create_grant(project_id=3312b317832c42c9b0a097fd4c3c0498, user_id=6db9f53e5e204abfb8f89a041b8c26a9, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.570467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6cb28-6aa1-4ee7-b73a-c0f94c31eace admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.606754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 646/1282] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/bdf3227ff2d243059363c56af7f0fa83/users/8b776d8c840b4b45b162c302d7cd7234/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:04.607570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.663497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 637/1283] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/3312b317832c42c9b0a097fd4c3c0498/users/6db9f53e5e204abfb8f89a041b8c26a9/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:04.665240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3bd6-57fd-4fb3-b122-8d4edd181087 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.665521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3bd6-57fd-4fb3-b122-8d4edd181087 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.665789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3bd6-57fd-4fb3-b122-8d4edd181087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.671540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc2469-29c0-4f60-8280-918cacd7da0e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.684912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2edc3bd6-57fd-4fb3-b122-8d4edd181087 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:04.686155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2edc3bd6-57fd-4fb3-b122-8d4edd181087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:04.722287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:04.732292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d92ad-bc35-4997-86c9-bd5dee26813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.732946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d92ad-bc35-4997-86c9-bd5dee26813d admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.733225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d92ad-bc35-4997-86c9-bd5dee26813d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.733497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d92ad-bc35-4997-86c9-bd5dee26813d admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.734148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d92ad-bc35-4997-86c9-bd5dee26813d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.736044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d92ad-bc35-4997-86c9-bd5dee26813d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.746754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 647/1284] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:04.753175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 638/1285] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:04.759863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a651c-7aa6-4ebc-8c7a-f3473e922e1b None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.760498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65aa45-b02e-4748-b5f3-677955900989 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.760706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a651c-7aa6-4ebc-8c7a-f3473e922e1b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.760797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65aa45-b02e-4748-b5f3-677955900989 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.760797 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65aa45-b02e-4748-b5f3-677955900989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.760945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a651c-7aa6-4ebc-8c7a-f3473e922e1b None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.760945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 648/1286] 10.222.0.39 () {54 vars in 912 bytes} [Wed Nov 2 07:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:04.760945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a651c-7aa6-4ebc-8c7a-f3473e922e1b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.775404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a651c-7aa6-4ebc-8c7a-f3473e922e1b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.783197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842330f-6fd9-47a8-8061-b2bfa0f7494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:04.784052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842330f-6fd9-47a8-8061-b2bfa0f7494d admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.796182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842330f-6fd9-47a8-8061-b2bfa0f7494d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.796182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842330f-6fd9-47a8-8061-b2bfa0f7494d admin admin] PATH_INFO: `/v3/projects/9b17cef9bee64114bec02b682359ead7/users/86f173866b014ce69c82c6c2eed4c719/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.796419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ae65aa45-b02e-4748-b5f3-677955900989 None None] MFA Rules not processed for user `54796ad6bde2408db66e0802605b8efa`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:04.796419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ae65aa45-b02e-4748-b5f3-677955900989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:04.801445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842330f-6fd9-47a8-8061-b2bfa0f7494d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b17cef9bee64114bec02b682359ead7, user_id=86f173866b014ce69c82c6c2eed4c719, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:04.804092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842330f-6fd9-47a8-8061-b2bfa0f7494d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:04.853903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 639/1287] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:04.855410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6183-009a-41be-a076-6aa9859d6245 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.855700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6183-009a-41be-a076-6aa9859d6245 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.855975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad6183-009a-41be-a076-6aa9859d6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.883509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-23ad6183-009a-41be-a076-6aa9859d6245 None None] MFA Rules not processed for user `8b776d8c840b4b45b162c302d7cd7234`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:04.884729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-23ad6183-009a-41be-a076-6aa9859d6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:04.899650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 649/1288] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/9b17cef9bee64114bec02b682359ead7/users/86f173866b014ce69c82c6c2eed4c719/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:04.900925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7270-fb4b-4614-b1bf-1efd23d3888a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:04.901208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7270-fb4b-4614-b1bf-1efd23d3888a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:04.901947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7270-fb4b-4614-b1bf-1efd23d3888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:04.922868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-631c7270-fb4b-4614-b1bf-1efd23d3888a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:04.923967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-631c7270-fb4b-4614-b1bf-1efd23d3888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:04.934923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:04.950910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 640/1289] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:04.951802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6183-009a-41be-a076-6aa9859d6245 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:04.966166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad6183-009a-41be-a076-6aa9859d6245 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:04.998547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 650/1290] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:05.002857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.002857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.002857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.021540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:05.022846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.046330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.047508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.047508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.047807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] PATH_INFO: `/v3/projects/7c14db6e37204767ba908fd32fee27c8/users/e1f0823971c149cd8557168a62affc4d/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.050287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:05.066680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c14db6e37204767ba908fd32fee27c8, user_id=e1f0823971c149cd8557168a62affc4d, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.070208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.100153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 651/1291] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:05.101082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.103280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.163733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 641/1292] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:04 2022] PUT /identity/v3/projects/7c14db6e37204767ba908fd32fee27c8/users/e1f0823971c149cd8557168a62affc4d/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:05.164963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.167736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6d7c-3d18-4754-9168-a3a3b690d2b6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.230279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bea25c-87b3-4f63-8575-09793bcbf98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.231246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bea25c-87b3-4f63-8575-09793bcbf98c service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.231725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bea25c-87b3-4f63-8575-09793bcbf98c service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.232068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bea25c-87b3-4f63-8575-09793bcbf98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.241537 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8e68a-9733-4fc3-9cdc-ee5499273d67 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.244862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bea25c-87b3-4f63-8575-09793bcbf98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.246343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bea25c-87b3-4f63-8575-09793bcbf98c service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.253623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.254248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.254522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.254789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.255425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.257358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.265556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 652/1293] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:05.267104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd15ef-2779-4f03-8750-455118b5cd5f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.267489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd15ef-2779-4f03-8750-455118b5cd5f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.267855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd15ef-2779-4f03-8750-455118b5cd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.284328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:05.290890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-40dd15ef-2779-4f03-8750-455118b5cd5f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:05.292260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-40dd15ef-2779-4f03-8750-455118b5cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.300399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 653/1294] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:05.310057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd15ef-2779-4f03-8750-455118b5cd5f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.367664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd15ef-2779-4f03-8750-455118b5cd5f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.370772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 642/1295] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:05.371543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.374346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.374968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.375251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.375984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.436370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e569f5-aab6-44a0-872d-23e990ad8528 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.440618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187ed78-2b21-4d16-a01b-c070fab0c852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.441297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ed78-2b21-4d16-a01b-c070fab0c852 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.441640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ed78-2b21-4d16-a01b-c070fab0c852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.441919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ed78-2b21-4d16-a01b-c070fab0c852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.459210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.461000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.471802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 654/1296] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:05.472736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.483972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60af48d-a3d5-4656-9920-308e95cd103a service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.515700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187ed78-2b21-4d16-a01b-c070fab0c852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.520580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187ed78-2b21-4d16-a01b-c070fab0c852 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.533671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 643/1297] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:05.537072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029811-c7e7-4ddd-b42b-c9a0b5dd7623 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.537355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029811-c7e7-4ddd-b42b-c9a0b5dd7623 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.538803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea029811-c7e7-4ddd-b42b-c9a0b5dd7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.612939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ea029811-c7e7-4ddd-b42b-c9a0b5dd7623 None None] MFA Rules not processed for user `e1f0823971c149cd8557168a62affc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:05.614163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea029811-c7e7-4ddd-b42b-c9a0b5dd7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.621373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c873aa-5028-4c20-b1f3-69c0484c9745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.622122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c873aa-5028-4c20-b1f3-69c0484c9745 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.622471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c873aa-5028-4c20-b1f3-69c0484c9745 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.622808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c873aa-5028-4c20-b1f3-69c0484c9745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.623016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:05.715587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 644/1298] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:05.716622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029811-c7e7-4ddd-b42b-c9a0b5dd7623 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.730066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea029811-c7e7-4ddd-b42b-c9a0b5dd7623 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.734204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.734839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.735099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.735367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.747819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.749991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.751304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:05.758616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c873aa-5028-4c20-b1f3-69c0484c9745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.760091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c873aa-5028-4c20-b1f3-69c0484c9745 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.764322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 645/1299] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:05.765878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.778763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72495ca0-45de-45c7-ba0e-9d9b4b81eec2 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.792330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.793005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.793284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.794888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.796472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.800802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.812893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 655/1300] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:05.812893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06a0e-22e7-4f68-a40d-df1ee247a687 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.814483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06a0e-22e7-4f68-a40d-df1ee247a687 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.815019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e06a0e-22e7-4f68-a40d-df1ee247a687 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.818747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 656/1301] 10.222.0.39 () {54 vars in 961 bytes} [Wed Nov 2 07:41:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:05.826403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2996-2fa4-42a6-afdc-802411d60406 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.826940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2996-2fa4-42a6-afdc-802411d60406 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.827436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb2996-2fa4-42a6-afdc-802411d60406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.880660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a0cb2996-2fa4-42a6-afdc-802411d60406 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:05.880660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a0cb2996-2fa4-42a6-afdc-802411d60406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:05.883815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 657/1302] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:05.894517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2996-2fa4-42a6-afdc-802411d60406 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:05.910359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb2996-2fa4-42a6-afdc-802411d60406 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:05.919979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:05.920703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:05.921170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:05.921636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:05.938582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:05.940475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:05.956333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 658/1303] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:06.020011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 646/1304] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:05 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:06.024335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:06.041549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eac94-d9b6-46fe-812a-e8e866ef4af3 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:06.059237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:06.059910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.060189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.062401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.063129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:06.066123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:06.097811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 659/1305] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:06.107051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:06.139857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d84c-c924-4fe8-a6e7-87c5709c3770 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:06.149103 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:06.149778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.150057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.150329 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] PATH_INFO: `/v3/projects/63d199ef01a44b5d9989cff85c06ceee/users/e74e1770a0e94e4ea93b95cb4dc4786e/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.169712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d199ef01a44b5d9989cff85c06ceee, user_id=e74e1770a0e94e4ea93b95cb4dc4786e, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:06.172639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:06.286908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 647/1306] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:06 2022] PUT /identity/v3/projects/63d199ef01a44b5d9989cff85c06ceee/users/e74e1770a0e94e4ea93b95cb4dc4786e/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:06.287956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:06.306344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ccc84-4e4d-41aa-b486-1e143e24d21b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:06.487980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e9b06-5026-4616-9bf3-44839c51bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:06.487980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e9b06-5026-4616-9bf3-44839c51bad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.487980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e9b06-5026-4616-9bf3-44839c51bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.487980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e9b06-5026-4616-9bf3-44839c51bad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.499732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e9b06-5026-4616-9bf3-44839c51bad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:06.499732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e9b06-5026-4616-9bf3-44839c51bad2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:06.523198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 660/1307] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:06.525927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:06.538076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0b7f-f5c2-42b6-8eb8-5588c85d6b2d None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.538356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0b7f-f5c2-42b6-8eb8-5588c85d6b2d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.538702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0b7f-f5c2-42b6-8eb8-5588c85d6b2d None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.540868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 661/1308] 10.222.0.39 () {54 vars in 912 bytes} [Wed Nov 2 07:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:41:06.545400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c31d5-bef2-4554-acc8-384dbd9d126e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:06.553305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e44ba-e14e-4917-8a8d-74db1dad66d7 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.553584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e44ba-e14e-4917-8a8d-74db1dad66d7 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.553850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e44ba-e14e-4917-8a8d-74db1dad66d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.562568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09f37e-31b0-4695-ad83-ed5e7da9b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:06.563355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09f37e-31b0-4695-ad83-ed5e7da9b614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.563838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09f37e-31b0-4695-ad83-ed5e7da9b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.564153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09f37e-31b0-4695-ad83-ed5e7da9b614 admin admin] PATH_INFO: `/v3/projects/63d199ef01a44b5d9989cff85c06ceee/users/e74e1770a0e94e4ea93b95cb4dc4786e/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.567731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09f37e-31b0-4695-ad83-ed5e7da9b614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d199ef01a44b5d9989cff85c06ceee, user_id=e74e1770a0e94e4ea93b95cb4dc4786e, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:06.574271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09f37e-31b0-4695-ad83-ed5e7da9b614 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:06.589605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a15e44ba-e14e-4917-8a8d-74db1dad66d7 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:06.592607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 648/1309] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:06 2022] PUT /identity/v3/projects/63d199ef01a44b5d9989cff85c06ceee/users/e74e1770a0e94e4ea93b95cb4dc4786e/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:06.594172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829579d9-acc4-40f5-bff7-09f82ccc0450 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:06.594457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829579d9-acc4-40f5-bff7-09f82ccc0450 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:06.594729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829579d9-acc4-40f5-bff7-09f82ccc0450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:06.595085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a15e44ba-e14e-4917-8a8d-74db1dad66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:06.643614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-829579d9-acc4-40f5-bff7-09f82ccc0450 None None] MFA Rules not processed for user `e74e1770a0e94e4ea93b95cb4dc4786e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:06.649223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-829579d9-acc4-40f5-bff7-09f82ccc0450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:06.726920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 662/1310] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:06.753203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 649/1311] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:06.937181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e44ba-e14e-4917-8a8d-74db1dad66d7 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:07.015638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e44ba-e14e-4917-8a8d-74db1dad66d7 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:07.027060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:07.028871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:07.028871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:07.028871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:07.040949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:07.056994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:07.060312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:07.092768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 663/1312] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:07.100655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829579d9-acc4-40f5-bff7-09f82ccc0450 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:07.124484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829579d9-acc4-40f5-bff7-09f82ccc0450 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:07.131298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:07.132165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:07.132750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:07.133802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:07.158748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:07.166108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:07.201541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 650/1313] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:07.499460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:07.584566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:07.595150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd0065-5949-4225-8d44-9d54332a740a service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:07.614277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c17ac-6284-41d3-85c8-867d7dd71f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:07.615159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c17ac-6284-41d3-85c8-867d7dd71f9b service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:07.616598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c17ac-6284-41d3-85c8-867d7dd71f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:07.619579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c17ac-6284-41d3-85c8-867d7dd71f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:07.649963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c56eb-ff2b-4eb6-948d-065ec581c4f8 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:07.650342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:07.660312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:07.661006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:07.661288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:07.661563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] PATH_INFO: `/v3/users/e1f0823971c149cd8557168a62affc4d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:07.665025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f0823971c149cd8557168a62affc4d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:07.666983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:07.766042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c17ac-6284-41d3-85c8-867d7dd71f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:07.768527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c17ac-6284-41d3-85c8-867d7dd71f9b service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:07.782543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 651/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:07.933895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f0823971c149cd8557168a62affc4d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.933895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f0823971c149cd8557168a62affc4d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.973194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f0823971c149cd8557168a62affc4d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:07.989812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f0823971c149cd8557168a62affc4d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:08.090064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f0823971c149cd8557168a62affc4d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:08.101017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 664/1315] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:07 2022] DELETE /identity/v3/users/e1f0823971c149cd8557168a62affc4d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:08.106345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:08.106636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:08.106999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:08.156000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:08.161242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:08.239187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 652/1316] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:08.264121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:08.271389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:08.419028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f773-68b5-4c1a-a839-1b55603c9c75 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:08.427028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b998-6bac-41d3-9415-bc15fcbc1d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:08.427028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b998-6bac-41d3-9415-bc15fcbc1d97 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:08.427028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b998-6bac-41d3-9415-bc15fcbc1d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:08.427028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b998-6bac-41d3-9415-bc15fcbc1d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:08.434922 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b998-6bac-41d3-9415-bc15fcbc1d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:08.436360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b998-6bac-41d3-9415-bc15fcbc1d97 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:08.461977 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 665/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:09.539616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:09.544481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:09.578072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9d29f-ed3d-431a-81cd-4c60871cbf49 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:09.614004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:09.615822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:09.618390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:09.620362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] PATH_INFO: `/v3/projects/7c14db6e37204767ba908fd32fee27c8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:09.624283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c14db6e37204767ba908fd32fee27c8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:09.632281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:09.858216 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c14db6e37204767ba908fd32fee27c8', 'request_id': 'req-264c901b-fde7-46e9-8c0d-d9889003d945'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:09.874618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c14db6e37204767ba908fd32fee27c8', 'request_id': 'req-264c901b-fde7-46e9-8c0d-d9889003d945'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:09.891849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c14db6e37204767ba908fd32fee27c8', 'request_id': 'req-264c901b-fde7-46e9-8c0d-d9889003d945'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.003161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] The token cache is being invalidate because project 7c14db6e37204767ba908fd32fee27c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:10.003463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.004123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-264c901b-fde7-46e9-8c0d-d9889003d945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:10.009948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 653/1318] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:09 2022] DELETE /identity/v3/projects/7c14db6e37204767ba908fd32fee27c8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:10.011284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8ab2-8815-4c82-a6e1-b86be97eb3cb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.013428 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8ab2-8815-4c82-a6e1-b86be97eb3cb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.013428 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc8ab2-8815-4c82-a6e1-b86be97eb3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.064843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d8fc8ab2-8815-4c82-a6e1-b86be97eb3cb None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:10.066349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d8fc8ab2-8815-4c82-a6e1-b86be97eb3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.094317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:10.175868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 666/1319] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:10.185675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3050f-558c-4010-81d4-06eaf9634436 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.186502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3050f-558c-4010-81d4-06eaf9634436 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.186964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3050f-558c-4010-81d4-06eaf9634436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.221255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5cf3050f-558c-4010-81d4-06eaf9634436 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:10.222792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5cf3050f-558c-4010-81d4-06eaf9634436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:10.240679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 654/1320] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:10.241774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc8ab2-8815-4c82-a6e1-b86be97eb3cb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.257732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc8ab2-8815-4c82-a6e1-b86be97eb3cb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.265062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.266522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.267385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.267850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.268834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:10.269355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.272109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:10.292269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 667/1321] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:10.295366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3050f-558c-4010-81d4-06eaf9634436 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.318132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3050f-558c-4010-81d4-06eaf9634436 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.326694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.328006 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.328501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.328961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.330265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.333143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:10.541939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 655/1322] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:10 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:10.544810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.559296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e6823-2002-48b5-bc70-167013beb64a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.697078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.697916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.698362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.698793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.699613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.701921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:10.839400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 668/1323] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:10 2022] POST /identity/v3/users => generated 284 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:10.844205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.854794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:10.859186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9491d-e947-454e-859b-9f964917aae2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.881361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.885182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.885182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.885182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.893035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.894694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:10.919153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 656/1324] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:10.920862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:10.945146 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07262d20-fe99-4f9c-bf70-cb2a139d15ba admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:10.959378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53343fb-62a6-4691-bc4e-fe1b1ba08307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:10.960478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53343fb-62a6-4691-bc4e-fe1b1ba08307 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:10.960478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53343fb-62a6-4691-bc4e-fe1b1ba08307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:10.963818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53343fb-62a6-4691-bc4e-fe1b1ba08307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:10.964553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53343fb-62a6-4691-bc4e-fe1b1ba08307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:10.969678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53343fb-62a6-4691-bc4e-fe1b1ba08307 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:11.000381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 669/1325] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:11.004957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:11.018514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d19f5b-45f8-4c79-aab6-60608d84edde admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:11.037143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:11.045113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.045391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.045746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] PATH_INFO: `/v3/projects/0ec0ccf7eea24c46835844a3b8753fcd/users/87101dd4242c4fe1bd81f19a22513581/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.107852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec0ccf7eea24c46835844a3b8753fcd, user_id=87101dd4242c4fe1bd81f19a22513581, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:11.119641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:11.262165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841a399-d33d-4abb-8fe5-11d0ce8b16f6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.263236 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 657/1326] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:11 2022] PUT /identity/v3/projects/0ec0ccf7eea24c46835844a3b8753fcd/users/87101dd4242c4fe1bd81f19a22513581/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:11.263775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841a399-d33d-4abb-8fe5-11d0ce8b16f6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.269595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4841a399-d33d-4abb-8fe5-11d0ce8b16f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.363521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4841a399-d33d-4abb-8fe5-11d0ce8b16f6 None None] MFA Rules not processed for user `87101dd4242c4fe1bd81f19a22513581`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:11.370669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4841a399-d33d-4abb-8fe5-11d0ce8b16f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:11.540313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 670/1327] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:11.544969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:11.755067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e221c8-da57-4bff-8ceb-ff57bd257afb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:11.779112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:11.780057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:11.780822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:11.786554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:11.786554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:11.786554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:11.937026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 658/1328] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:11 2022] POST /identity/v3/projects => generated 367 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:11.942974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841a399-d33d-4abb-8fe5-11d0ce8b16f6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:11.965595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4841a399-d33d-4abb-8fe5-11d0ce8b16f6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.015205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:12.122624 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.137415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.144899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.145214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.146066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.160033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.305627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 671/1329] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:11 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:12.310317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.340301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8014fa4-f51c-4bc1-ad5d-291bc04f7573 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.350268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.350884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.351158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.352258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.353106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.354951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.386393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 659/1330] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:12.386763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.410278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c078e4-0013-40ca-84c4-a8350ffb2637 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.432369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.433260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.437780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.437780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] PATH_INFO: `/v3/projects/1ef7d4b576a14ae9b2b47228252f2715/users/32642f7ef81b4e0bafdc08a3502e7e67/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.466817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef7d4b576a14ae9b2b47228252f2715, user_id=32642f7ef81b4e0bafdc08a3502e7e67, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.470508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.618988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 672/1331] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:12 2022] PUT /identity/v3/projects/1ef7d4b576a14ae9b2b47228252f2715/users/32642f7ef81b4e0bafdc08a3502e7e67/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:12.623882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.651531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ef418-4ec6-4073-8eec-534b32aea166 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.825684 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49483cee-c74c-4393-a93e-835c6a6a6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.826184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49483cee-c74c-4393-a93e-835c6a6a6688 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.826474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49483cee-c74c-4393-a93e-835c6a6a6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.826736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49483cee-c74c-4393-a93e-835c6a6a6688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.827563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49483cee-c74c-4393-a93e-835c6a6a6688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.838600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49483cee-c74c-4393-a93e-835c6a6a6688 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.859500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:12.861685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 660/1332] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:12.871117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e49ddb-8897-4603-8c5a-0745c855b949 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:12.889390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:12.890350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.890797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.891065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] PATH_INFO: `/v3/projects/1ef7d4b576a14ae9b2b47228252f2715/users/32642f7ef81b4e0bafdc08a3502e7e67/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.893054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef7d4b576a14ae9b2b47228252f2715, user_id=32642f7ef81b4e0bafdc08a3502e7e67, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:12.895699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:12.919497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 673/1333] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:12 2022] PUT /identity/v3/projects/1ef7d4b576a14ae9b2b47228252f2715/users/32642f7ef81b4e0bafdc08a3502e7e67/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:12.930286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:12.930591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:12.930935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:12.983121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] MFA Rules not processed for user `32642f7ef81b4e0bafdc08a3502e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:12.984516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:13.035499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:13.094290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 661/1334] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:13.107626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.112748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:13.249220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25079-64c4-4f98-8796-12f8c3a23b20 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.259412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.260777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.261129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.261853 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.283160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.291325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.308271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 674/1335] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:13.541828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:13.543200 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:13.557034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea03b-c17d-4e07-8f02-07cf14da09f8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:13.561447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690f1e9-8482-41ae-b7c3-c21395525527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:13.562359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f1e9-8482-41ae-b7c3-c21395525527 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:13.562795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f1e9-8482-41ae-b7c3-c21395525527 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:13.563809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690f1e9-8482-41ae-b7c3-c21395525527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:13.712153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690f1e9-8482-41ae-b7c3-c21395525527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:13.720066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690f1e9-8482-41ae-b7c3-c21395525527 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:13.758555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 662/1336] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:14.715952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:14.720091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:14.906376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0e362-99c9-441e-a7cf-4b7c95373092 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:14.929401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:14.930194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:14.931674 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:14.932378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] PATH_INFO: `/v3/users/54796ad6bde2408db66e0802605b8efa` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:14.936524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=54796ad6bde2408db66e0802605b8efa)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:14.941884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:14.997719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:15.284989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54796ad6bde2408db66e0802605b8efa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.285870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54796ad6bde2408db66e0802605b8efa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.331167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54796ad6bde2408db66e0802605b8efa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.349766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54796ad6bde2408db66e0802605b8efa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.444410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54796ad6bde2408db66e0802605b8efa'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:15.454987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 675/1337] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:14 2022] DELETE /identity/v3/users/54796ad6bde2408db66e0802605b8efa => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:15.463415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.463415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.463415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.509660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:15.515353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:15.704727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 663/1338] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:15.747985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:15.747985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:15.859057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87ed40-d5fb-41b0-ba35-0405e8ea58ed admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:15.865937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed689120-bd23-4152-8f57-5736cbc9df0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:15.866575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689120-bd23-4152-8f57-5736cbc9df0f service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:15.867227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689120-bd23-4152-8f57-5736cbc9df0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:15.867793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689120-bd23-4152-8f57-5736cbc9df0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:15.880162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed689120-bd23-4152-8f57-5736cbc9df0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:15.882037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed689120-bd23-4152-8f57-5736cbc9df0f service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:15.896699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 676/1339] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:16.526619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:16.526619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:16.552078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda83472-1a86-4d84-9163-efe52d80cf45 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:16.577186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:16.577842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:16.578115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:16.578392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] PATH_INFO: `/v3/users/d02758a7cddc4e97948d2bd1558ed597` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:16.580671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02758a7cddc4e97948d2bd1558ed597)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:16.581699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:16.581699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: warnings.warn(msg) Nov 02 07:41:16.581699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: Nov 02 07:41:16.582917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:16.927294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02758a7cddc4e97948d2bd1558ed597'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.961714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02758a7cddc4e97948d2bd1558ed597'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.966515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02758a7cddc4e97948d2bd1558ed597'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.969411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02758a7cddc4e97948d2bd1558ed597'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:16.973746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:17.056219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.057081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.057527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.057752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6485653d-1693-4606-bd91-4f82c5e564d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02758a7cddc4e97948d2bd1558ed597'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.105915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 664/1340] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:16 2022] DELETE /identity/v3/users/d02758a7cddc4e97948d2bd1558ed597 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:17.108898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.114632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.115177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.115842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] MFA Rules not processed for user `86f173866b014ce69c82c6c2eed4c719`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:17.117428 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.167101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:17.175523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.255797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 677/1341] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:17.257413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.260500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.335254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:17.359098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 665/1342] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:17.361588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.369342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.438227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671a6da-f94f-41d6-b55d-d50753503c84 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.471063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:17.485713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.485713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.485713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] PATH_INFO: `/v3/projects/8349176e48bc45d79ee52f133f9541c9` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.485713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8349176e48bc45d79ee52f133f9541c9)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:17.485713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: WARNING py.warnings [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 07:41:17.485713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: warnings.warn(msg) Nov 02 07:41:17.485713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: Nov 02 07:41:17.487000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.578991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcba4-48d6-44fc-8f3d-7ccd27e2e8c4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.596977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:17.597612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:17.597889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:17.598158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:17.630990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:17.634158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:17.694580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 666/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:17.694580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.694580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:17.745642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8349176e48bc45d79ee52f133f9541c9', 'request_id': 'req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.789507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8349176e48bc45d79ee52f133f9541c9', 'request_id': 'req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.817930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8349176e48bc45d79ee52f133f9541c9', 'request_id': 'req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.828868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559c97a-0a4b-4311-90fa-d76f5222dcc2 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:17.936812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] The token cache is being invalidate because project 8349176e48bc45d79ee52f133f9541c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:17.939967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.939967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:17.941591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 678/1344] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:17 2022] DELETE /identity/v3/projects/8349176e48bc45d79ee52f133f9541c9 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:17.948026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:17.951259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.089812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d098a55-02e5-43a9-8408-d27fc8f7ee9a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:18.105401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.106370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.106743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.107106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.113818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:18.128109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:18.132870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:18.136712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:18.137270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] PATH_INFO: `/v3/users/e74e1770a0e94e4ea93b95cb4dc4786e` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:18.145080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.146329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74e1770a0e94e4ea93b95cb4dc4786e)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:18.147812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.151801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:18.209406 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 667/1345] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:18.529374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74e1770a0e94e4ea93b95cb4dc4786e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.533658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74e1770a0e94e4ea93b95cb4dc4786e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.566510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74e1770a0e94e4ea93b95cb4dc4786e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.579156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74e1770a0e94e4ea93b95cb4dc4786e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.658175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5abbf48b-a1eb-4c41-bb98-d68c0182421b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74e1770a0e94e4ea93b95cb4dc4786e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:18.666101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 679/1346] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:17 2022] DELETE /identity/v3/users/e74e1770a0e94e4ea93b95cb4dc4786e => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:19.298788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:19.644945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:19.726854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:19.730761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:19.785686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2a0d6-fba4-4682-8330-bbf1737d3f2b service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:19.865602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.865881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.866369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.928402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] MFA Rules not processed for user `207560d0ab0b4fe0bae750ac180f37bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:19.929940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:19.930613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:19.930730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:19.930913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:19.931190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] PATH_INFO: `/v3/projects/ac4f8b9a762e453491cc427d4dbf0627` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:19.933351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4f8b9a762e453491cc427d4dbf0627)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:19.938298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.093090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 680/1347] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:20.106627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.108054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.164088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4f8b9a762e453491cc427d4dbf0627', 'request_id': 'req-21169163-4a70-4a08-8d4d-99bce58addea'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:20.182892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4f8b9a762e453491cc427d4dbf0627', 'request_id': 'req-21169163-4a70-4a08-8d4d-99bce58addea'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:20.203845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4f8b9a762e453491cc427d4dbf0627', 'request_id': 'req-21169163-4a70-4a08-8d4d-99bce58addea'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:20.276333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e28d95-b47f-4c86-a21a-af122c0dc008 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.303591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] The token cache is being invalidate because project ac4f8b9a762e453491cc427d4dbf0627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:20.304971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:20.305093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-21169163-4a70-4a08-8d4d-99bce58addea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:20.306740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 668/1348] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:19 2022] DELETE /identity/v3/projects/ac4f8b9a762e453491cc427d4dbf0627 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:20.315031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.315348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.318559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.380310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:20.385452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.418505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482e513-2bf8-4274-9b43-9a80343c6bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.419127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e513-2bf8-4274-9b43-9a80343c6bff service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.419403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e513-2bf8-4274-9b43-9a80343c6bff service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.419665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e513-2bf8-4274-9b43-9a80343c6bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.422126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1482e513-2bf8-4274-9b43-9a80343c6bff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.561990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482e513-2bf8-4274-9b43-9a80343c6bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.563591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482e513-2bf8-4274-9b43-9a80343c6bff service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.576773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 681/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:20.581045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 669/1350] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:20.593152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.595497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.605370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a791411-e19c-4674-b7ac-cce5ae9f4de0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.605655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a791411-e19c-4674-b7ac-cce5ae9f4de0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.605930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a791411-e19c-4674-b7ac-cce5ae9f4de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.635153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211777c7-340b-4bf7-bf1f-420560ec6b91 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.651291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.651945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.652221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.654007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] PATH_INFO: `/v3/users/87101dd4242c4fe1bd81f19a22513581` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.659336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87101dd4242c4fe1bd81f19a22513581)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.673014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.684220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0a791411-e19c-4674-b7ac-cce5ae9f4de0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:20.690679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0a791411-e19c-4674-b7ac-cce5ae9f4de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:20.716762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 682/1351] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:20.718909 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a791411-e19c-4674-b7ac-cce5ae9f4de0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.752372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a791411-e19c-4674-b7ac-cce5ae9f4de0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.769109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.772326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.772949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.773114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.773871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:20.774167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.775869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:20.800723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 683/1352] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:20.805532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:20.827937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71d184-a881-44df-bcc0-7f88c99656f8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:20.845793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:20.846965 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:20.847431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:20.847872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:20.849072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:20.852308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.001956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 684/1353] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:20 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:21.004776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.017796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.024530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87101dd4242c4fe1bd81f19a22513581'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.055770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87101dd4242c4fe1bd81f19a22513581'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.057435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87101dd4242c4fe1bd81f19a22513581'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.059206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87101dd4242c4fe1bd81f19a22513581'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.161230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87101dd4242c4fe1bd81f19a22513581'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.215592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf0712-abcf-45b9-b86a-0c3c056fdddb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.230836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.234556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.234695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:21.234832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.236634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] PATH_INFO: `/v3/projects/63d199ef01a44b5d9989cff85c06ceee` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.239197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d199ef01a44b5d9989cff85c06ceee)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.243836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.250832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 670/1354] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:20 2022] DELETE /identity/v3/users/87101dd4242c4fe1bd81f19a22513581 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:21.250832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.250832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.447536 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43733168-f9e0-428a-aed4-7d20949a1105 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.468699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d199ef01a44b5d9989cff85c06ceee', 'request_id': 'req-1169ef0e-b010-4811-a53f-a4898a4e1ccf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.492612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d199ef01a44b5d9989cff85c06ceee', 'request_id': 'req-1169ef0e-b010-4811-a53f-a4898a4e1ccf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.502896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d199ef01a44b5d9989cff85c06ceee', 'request_id': 'req-1169ef0e-b010-4811-a53f-a4898a4e1ccf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.557688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.558061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.558554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.559481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.561335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.568745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.625080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] The token cache is being invalidate because project 63d199ef01a44b5d9989cff85c06ceee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:21.625080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.625351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1169ef0e-b010-4811-a53f-a4898a4e1ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:21.633916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 685/1355] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:21 2022] DELETE /identity/v3/projects/63d199ef01a44b5d9989cff85c06ceee => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:21.634875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f607-5d84-43f1-b5f8-0659f46e7e44 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.635715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f607-5d84-43f1-b5f8-0659f46e7e44 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.637450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f607-5d84-43f1-b5f8-0659f46e7e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.666382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8e33f607-5d84-43f1-b5f8-0659f46e7e44 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:21.669197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8e33f607-5d84-43f1-b5f8-0659f46e7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.688188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 686/1356] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:21.688188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.688188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.688188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.716869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 671/1357] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:21 2022] POST /identity/v3/users => generated 283 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:21.722159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.727679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.741668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:21.743045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.754823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72244-74a8-4874-8282-d4755ea89b97 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.757920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 687/1358] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:21.765562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.768561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.774629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a80b1-3613-4231-813e-735fa9805b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.780091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a80b1-3613-4231-813e-735fa9805b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.780091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a80b1-3613-4231-813e-735fa9805b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.780091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a80b1-3613-4231-813e-735fa9805b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.780091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a80b1-3613-4231-813e-735fa9805b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.782629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a80b1-3613-4231-813e-735fa9805b33 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.810240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 672/1359] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:21.814384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44dcf-c277-4c37-9fab-430f6261be7b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.816647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44dcf-c277-4c37-9fab-430f6261be7b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.816978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44dcf-c277-4c37-9fab-430f6261be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.884571 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b2b44dcf-c277-4c37-9fab-430f6261be7b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:21.886198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b2b44dcf-c277-4c37-9fab-430f6261be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:21.905826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 673/1360] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:21.906705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44dcf-c277-4c37-9fab-430f6261be7b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.923446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a1e3b-9511-4b72-b559-64a2dec914ee None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.936334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44dcf-c277-4c37-9fab-430f6261be7b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:21.937895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.938584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.938804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.939076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.946123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:21.946755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:21.947031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:21.947300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:21.948205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.949664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.963146 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:21.971351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:21.977680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 674/1361] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:21.980884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:21.990183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 688/1362] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:21.993996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.006795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963fb1-fb6c-4e52-b1b3-b2e89440eaf0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.015113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32a98-3683-4b95-92a6-aa85ebbb6efa service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.027116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.027116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.027116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.027116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.027435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:22.027435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.027435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.037454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be9477-5f20-46bd-85b6-a7cd4304e330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.038128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9477-5f20-46bd-85b6-a7cd4304e330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.038464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9477-5f20-46bd-85b6-a7cd4304e330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.038914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9477-5f20-46bd-85b6-a7cd4304e330 admin admin] PATH_INFO: `/v3/projects/63e3e19516a7428692a9e4a17fe01f5d/users/f50dece7381147768a7072fb26140927/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.070806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 675/1363] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:22.073833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.083872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9477-5f20-46bd-85b6-a7cd4304e330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e3e19516a7428692a9e4a17fe01f5d, user_id=f50dece7381147768a7072fb26140927, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.091841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9477-5f20-46bd-85b6-a7cd4304e330 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.098318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0938c-f843-4e22-b69b-1109cd251fca admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.106019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.107155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.107719 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.108200 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.109388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.111520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.145857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:22.215076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 689/1364] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:21 2022] PUT /identity/v3/projects/63e3e19516a7428692a9e4a17fe01f5d/users/f50dece7381147768a7072fb26140927/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:22.235657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c13f4-fbb5-45c4-a876-1a7d3f94917a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.235657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c13f4-fbb5-45c4-a876-1a7d3f94917a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.235657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c13f4-fbb5-45c4-a876-1a7d3f94917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.278888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 676/1365] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:22.282679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.362493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-714c13f4-fbb5-45c4-a876-1a7d3f94917a None None] MFA Rules not processed for user `f50dece7381147768a7072fb26140927`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:22.367994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-714c13f4-fbb5-45c4-a876-1a7d3f94917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:22.485525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e94a-43d1-453f-bb30-1d75fd409bbb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.488786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.490189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.490636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.491094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.492125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.495238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.593904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 690/1366] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:22.598513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c13f4-fbb5-45c4-a876-1a7d3f94917a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.612018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c13f4-fbb5-45c4-a876-1a7d3f94917a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.617748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.618902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.619390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.619869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.620975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.623161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.639583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 677/1367] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:22.643575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.678072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6d008-5dc7-4e1c-b29f-56b2fe8ded2e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.689941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.691424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.691856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.692266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.694361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.698626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.723088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 678/1368] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:22.727157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.749727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6748-5259-44ca-9b8c-3cd6e41911e7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.755024 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 691/1369] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:22.758564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.762206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.763017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.764419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.766383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.767311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.773414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.803117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 679/1370] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:22.806155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:22.827321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c174-7208-4dfc-9385-424d384fa388 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.903530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd547a-4a4f-4a05-a18c-584e141b2e66 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:22.917700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714f608-a86f-4d47-92c4-25fc96e54b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.919085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714f608-a86f-4d47-92c4-25fc96e54b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.919603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714f608-a86f-4d47-92c4-25fc96e54b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.919878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714f608-a86f-4d47-92c4-25fc96e54b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.921759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714f608-a86f-4d47-92c4-25fc96e54b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.925016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714f608-a86f-4d47-92c4-25fc96e54b9e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:22.967246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:22.969671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:22.969671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:22.969671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] PATH_INFO: `/v3/projects/e9d17fa53de24ef9aa143d4f6713e209/users/0ad50e9c18e24cc39a895981476bc9b1/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:22.995016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d17fa53de24ef9aa143d4f6713e209, user_id=0ad50e9c18e24cc39a895981476bc9b1, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:22.996890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.084194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 680/1371] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:22 2022] PUT /identity/v3/projects/e9d17fa53de24ef9aa143d4f6713e209/users/0ad50e9c18e24cc39a895981476bc9b1/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:23.092287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 692/1372] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:22 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:23.092419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.094974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967e627-7ab9-4d7d-ba0c-1a726ea21311 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.101589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967e627-7ab9-4d7d-ba0c-1a726ea21311 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.102071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967e627-7ab9-4d7d-ba0c-1a726ea21311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.197832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c967e627-7ab9-4d7d-ba0c-1a726ea21311 None None] MFA Rules not processed for user `0ad50e9c18e24cc39a895981476bc9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:23.202624 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c967e627-7ab9-4d7d-ba0c-1a726ea21311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.267823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef357fbd-5344-41b2-b5bb-2fb7b9645e9c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.279455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.280569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.281195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.281306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.282064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.283822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.309914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 681/1373] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:23.314135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.337107 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db83ca2-131d-460e-801c-51942652943a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.366203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 693/1374] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:23.369922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b686b-29fc-4001-bfe3-7dac0288cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.370728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b686b-29fc-4001-bfe3-7dac0288cb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.371116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b686b-29fc-4001-bfe3-7dac0288cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.371489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b686b-29fc-4001-bfe3-7dac0288cb63 admin admin] PATH_INFO: `/v3/projects/4a543b81ef5445399880b7d910368518/users/27a6d760a1ff4f9bb4522a7ca32baf76/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.372732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967e627-7ab9-4d7d-ba0c-1a726ea21311 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.380105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:23.388811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967e627-7ab9-4d7d-ba0c-1a726ea21311 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.400266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.402313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.402717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.403142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.404379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.406294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b686b-29fc-4001-bfe3-7dac0288cb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a543b81ef5445399880b7d910368518, user_id=27a6d760a1ff4f9bb4522a7ca32baf76, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.407361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.415923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b686b-29fc-4001-bfe3-7dac0288cb63 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.535608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 694/1375] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:23.536502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:23.540885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.541450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 682/1376] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:23 2022] PUT /identity/v3/projects/4a543b81ef5445399880b7d910368518/users/27a6d760a1ff4f9bb4522a7ca32baf76/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:23.543651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d23b-bb88-4bae-963d-6d49df0d4651 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.545338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d23b-bb88-4bae-963d-6d49df0d4651 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.545835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01d23b-bb88-4bae-963d-6d49df0d4651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.624470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0a01d23b-bb88-4bae-963d-6d49df0d4651 None None] MFA Rules not processed for user `6db9f53e5e204abfb8f89a041b8c26a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:23.625657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a01d23b-bb88-4bae-963d-6d49df0d4651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:23.711510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751e154-ad96-4edf-ad29-17199fedc154 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:23.728596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:23.730012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.731669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.732178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] PATH_INFO: `/v3/users/8b776d8c840b4b45b162c302d7cd7234` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.738753 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b776d8c840b4b45b162c302d7cd7234)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:23.747399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:23.831764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 683/1377] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:23.833088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d31a2-26b4-4392-a013-08aa8edbb061 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:23.833369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d31a2-26b4-4392-a013-08aa8edbb061 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:23.833643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d31a2-26b4-4392-a013-08aa8edbb061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:23.880695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d72d31a2-26b4-4392-a013-08aa8edbb061 None None] MFA Rules not processed for user `a124ce6488f94a84a725330c79199df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:23.882478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d72d31a2-26b4-4392-a013-08aa8edbb061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.042092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 684/1378] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.043471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d31a2-26b4-4392-a013-08aa8edbb061 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.067267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b776d8c840b4b45b162c302d7cd7234'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.068552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b776d8c840b4b45b162c302d7cd7234'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.072359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d31a2-26b4-4392-a013-08aa8edbb061 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.082441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf0e21-a7ef-48e3-b325-3079a57ad3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.083819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf0e21-a7ef-48e3-b325-3079a57ad3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.083819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf0e21-a7ef-48e3-b325-3079a57ad3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.083819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf0e21-a7ef-48e3-b325-3079a57ad3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.084511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf0e21-a7ef-48e3-b325-3079a57ad3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.086649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b776d8c840b4b45b162c302d7cd7234'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.086770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf0e21-a7ef-48e3-b325-3079a57ad3f0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.097014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b776d8c840b4b45b162c302d7cd7234'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.189113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b776d8c840b4b45b162c302d7cd7234'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.196988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 695/1379] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:23 2022] DELETE /identity/v3/users/8b776d8c840b4b45b162c302d7cd7234 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:24.200957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.202981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.203347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 685/1380] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:24.204869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99eb64-7a7d-42b6-8c32-cd856f2eaac0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.205672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99eb64-7a7d-42b6-8c32-cd856f2eaac0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.206026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99eb64-7a7d-42b6-8c32-cd856f2eaac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.237686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9f99eb64-7a7d-42b6-8c32-cd856f2eaac0 None None] MFA Rules not processed for user `6db9f53e5e204abfb8f89a041b8c26a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:24.241181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9f99eb64-7a7d-42b6-8c32-cd856f2eaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.271779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:24.346604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 686/1381] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.356224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d879de-4550-4691-8349-42e9196f12f0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.356903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d879de-4550-4691-8349-42e9196f12f0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.357318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d879de-4550-4691-8349-42e9196f12f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.358992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58d15d-e47c-4321-bc25-d89583ac7747 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.370909 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.373164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.373693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.374044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.376126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.380589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.395301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-97d879de-4550-4691-8349-42e9196f12f0 None None] MFA Rules not processed for user `a124ce6488f94a84a725330c79199df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:24.395886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 696/1382] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:24.397023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.399731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-97d879de-4550-4691-8349-42e9196f12f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.400772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.417996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0d659-9ab7-4c0a-9cdf-6f5c375c3943 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.424363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.425207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.425566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.425954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] PATH_INFO: `/v3/projects/0ec0ccf7eea24c46835844a3b8753fcd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.427301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec0ccf7eea24c46835844a3b8753fcd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.429600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.567781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 687/1383] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.569661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.569661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.569874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.597087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:24.598723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.611614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec0ccf7eea24c46835844a3b8753fcd', 'request_id': 'req-2327276f-d248-4e61-97f1-5b58a57d62c2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.629832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec0ccf7eea24c46835844a3b8753fcd', 'request_id': 'req-2327276f-d248-4e61-97f1-5b58a57d62c2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.639164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec0ccf7eea24c46835844a3b8753fcd', 'request_id': 'req-2327276f-d248-4e61-97f1-5b58a57d62c2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.712534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 688/1384] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:24.713867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.715007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.727780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] The token cache is being invalidate because project 0ec0ccf7eea24c46835844a3b8753fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:24.728126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.729084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:24.733988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 697/1385] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:24 2022] DELETE /identity/v3/projects/0ec0ccf7eea24c46835844a3b8753fcd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:24.733988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.734218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dd86b-0302-4eb6-a7e3-eae79afc8ff5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.736702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.747022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.751830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.751830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.751830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.751830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.751830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.769880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 689/1386] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:24.771960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.775076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.798869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831eb78-adc1-45e4-a07d-81abe700af44 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.812586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.814856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.815296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.816003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] PATH_INFO: `/v3/projects/4a543b81ef5445399880b7d910368518/users/27a6d760a1ff4f9bb4522a7ca32baf76/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:24.820643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a543b81ef5445399880b7d910368518, user_id=27a6d760a1ff4f9bb4522a7ca32baf76, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:24.825851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:24.852799 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 690/1387] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:24 2022] PUT /identity/v3/projects/4a543b81ef5445399880b7d910368518/users/27a6d760a1ff4f9bb4522a7ca32baf76/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:24.853909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:24.861332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:24.879690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327276f-d248-4e61-97f1-5b58a57d62c2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.986403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585784a0-ccd2-40eb-943f-1a8bac48f1da admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:24.996339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c5a00-bc05-42b3-b615-683b1c489a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:24.997170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c5a00-bc05-42b3-b615-683b1c489a6b service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:24.997591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c5a00-bc05-42b3-b615-683b1c489a6b service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:24.998138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c5a00-bc05-42b3-b615-683b1c489a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.000390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3d0c5a00-bc05-42b3-b615-683b1c489a6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.002740 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.003388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.005056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.005489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.013462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.092468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c5a00-bc05-42b3-b615-683b1c489a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.094309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c5a00-bc05-42b3-b615-683b1c489a6b service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.126843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 691/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:25.131044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.133054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.135525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.164939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.166722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.177319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 698/1389] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:25.178441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.180852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.199673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] MFA Rules not processed for user `86f173866b014ce69c82c6c2eed4c719`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:25.201612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.305851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eec31b-8ec3-43d8-bf14-65684036c607 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.326606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.328030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.328385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.329835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.341192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.406176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 692/1390] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:25.407348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.410372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.505886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.508095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.529882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 699/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:25.533687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.536021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.560366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62a0f-835e-4473-a2ac-144262f763ba None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.567509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047395d-1cc5-4d53-a47d-ac76becb5c78 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:25.572750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.573522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.574235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.575137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] PATH_INFO: `/v3/users/32642f7ef81b4e0bafdc08a3502e7e67` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.577177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32642f7ef81b4e0bafdc08a3502e7e67)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.579247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.585395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15572869-eb84-48ad-8621-301b1eda2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:25.586377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572869-eb84-48ad-8621-301b1eda2caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.586795 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572869-eb84-48ad-8621-301b1eda2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.587212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15572869-eb84-48ad-8621-301b1eda2caf admin admin] PATH_INFO: `/v3/projects/971411ae8a674a258088d624ad0af700/users/cb33224910a34fdcbf8862c6294d5965/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.627578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15572869-eb84-48ad-8621-301b1eda2caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=971411ae8a674a258088d624ad0af700, user_id=cb33224910a34fdcbf8862c6294d5965, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:25.636501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15572869-eb84-48ad-8621-301b1eda2caf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:25.722106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 700/1392] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:25 2022] PUT /identity/v3/projects/971411ae8a674a258088d624ad0af700/users/cb33224910a34fdcbf8862c6294d5965/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:25.723921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:25.724371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:25.724972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:25.814494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32642f7ef81b4e0bafdc08a3502e7e67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:25.824889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] MFA Rules not processed for user `27a6d760a1ff4f9bb4522a7ca32baf76`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:25.827654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:25.844000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32642f7ef81b4e0bafdc08a3502e7e67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:25.849454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32642f7ef81b4e0bafdc08a3502e7e67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:25.852102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32642f7ef81b4e0bafdc08a3502e7e67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:25.922730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32642f7ef81b4e0bafdc08a3502e7e67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:25.951471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:25.967353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 693/1393] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:25 2022] DELETE /identity/v3/users/32642f7ef81b4e0bafdc08a3502e7e67 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:25.968253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:25.972626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.047228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 701/1394] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:26.061806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:26.063386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.145015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4382b41-c340-47e8-9582-76e09da71477 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:26.160582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:26.161184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.161533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.161808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.162464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:26.165435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.193706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 694/1395] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:26.195802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:26.203352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9359ea-def1-4b6f-9c2f-d91a01c483b6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:26.217344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb9fc1-f9f4-4031-9922-fd737358eb1a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:26.229551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f3cc3-a978-4af7-af54-192b6956588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:26.231098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3cc3-a978-4af7-af54-192b6956588e admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.231390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3cc3-a978-4af7-af54-192b6956588e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.231754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3cc3-a978-4af7-af54-192b6956588e admin admin] PATH_INFO: `/v3/projects/971411ae8a674a258088d624ad0af700/users/cb33224910a34fdcbf8862c6294d5965/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.235812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3cc3-a978-4af7-af54-192b6956588e admin admin] RBAC: Authorizing `identity:create_grant(project_id=971411ae8a674a258088d624ad0af700, user_id=cb33224910a34fdcbf8862c6294d5965, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:26.241013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f3cc3-a978-4af7-af54-192b6956588e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.270569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 695/1396] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:26 2022] PUT /identity/v3/projects/971411ae8a674a258088d624ad0af700/users/cb33224910a34fdcbf8862c6294d5965/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:26.281120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2e102-ea75-4ee8-8c7e-722921b60397 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.281431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2e102-ea75-4ee8-8c7e-722921b60397 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.281694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2e102-ea75-4ee8-8c7e-722921b60397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.334465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:26.335364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.335817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.336239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.346165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fdc2e102-ea75-4ee8-8c7e-722921b60397 None None] MFA Rules not processed for user `cb33224910a34fdcbf8862c6294d5965`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:26.347961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fdc2e102-ea75-4ee8-8c7e-722921b60397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.493898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 696/1397] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:26.495763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dba57-affc-483a-be68-ac36fb9bf7f6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.496049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dba57-affc-483a-be68-ac36fb9bf7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.496324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dba57-affc-483a-be68-ac36fb9bf7f6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.497792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 697/1398] 10.222.0.39 () {54 vars in 912 bytes} [Wed Nov 2 07:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:26.504081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.504458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.504662 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.524232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:26.525630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.556588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 702/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:26.557614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:26.563970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.582133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] MFA Rules not processed for user `60e4cc87886d4b7788864eaf94334e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:26.583458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.584061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc10ce-503e-4953-a5e4-8c22119d0877 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:26.658102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:26.721476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 698/1400] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:26.775233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:26.775497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.775794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.780978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:26.784316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.789519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.801949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae27d-2ecf-4152-a121-227cd59d3f06 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:26.802633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:26.814520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11bc8d-df09-49dd-8134-75169b7ffbc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:26.815209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bc8d-df09-49dd-8134-75169b7ffbc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.815495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bc8d-df09-49dd-8134-75169b7ffbc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.815745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bc8d-df09-49dd-8134-75169b7ffbc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.838576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11bc8d-df09-49dd-8134-75169b7ffbc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:26.863045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11bc8d-df09-49dd-8134-75169b7ffbc3 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.912262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 699/1401] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:26.914379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0635994-af6f-4119-8c1e-c1c6562d4e3c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.916409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0635994-af6f-4119-8c1e-c1c6562d4e3c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.916984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0635994-af6f-4119-8c1e-c1c6562d4e3c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.918694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 700/1402] 10.222.0.39 () {54 vars in 912 bytes} [Wed Nov 2 07:41:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:26.937116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:26.938580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:26.938838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:26.939353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:26.941173 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:26.957883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 703/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:27.020958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] MFA Rules not processed for user `60e4cc87886d4b7788864eaf94334e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:27.027122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.066573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 701/1404] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:27.067829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.070268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.134127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.135874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.157793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b1c3c-226c-4284-ae96-68bd8f6e2d2f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:27.177064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64429-b08b-435e-ae82-485ab6cc4acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:27.179132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64429-b08b-435e-ae82-485ab6cc4acb service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.181896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64429-b08b-435e-ae82-485ab6cc4acb service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.183076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64429-b08b-435e-ae82-485ab6cc4acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.211141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c64429-b08b-435e-ae82-485ab6cc4acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:27.220557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c64429-b08b-435e-ae82-485ab6cc4acb service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:27.247408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 702/1405] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:27.305858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35eb65-827b-4cf2-86a1-56012e76de07 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:27.306724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:27.315149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:27.315996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.316394 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.316859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] PATH_INFO: `/v3/projects/bdf3227ff2d243059363c56af7f0fa83` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.318387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf3227ff2d243059363c56af7f0fa83)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:27.323026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:27.489052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf3227ff2d243059363c56af7f0fa83', 'request_id': 'req-b6cde44d-1d51-43a5-ada4-aa02930afc14'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.498540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf3227ff2d243059363c56af7f0fa83', 'request_id': 'req-b6cde44d-1d51-43a5-ada4-aa02930afc14'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.506007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf3227ff2d243059363c56af7f0fa83', 'request_id': 'req-b6cde44d-1d51-43a5-ada4-aa02930afc14'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.631147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.632458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.632874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.657730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] MFA Rules not processed for user `207560d0ab0b4fe0bae750ac180f37bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:27.661353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.676281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] The token cache is being invalidate because project bdf3227ff2d243059363c56af7f0fa83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:27.676281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.676281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b6cde44d-1d51-43a5-ada4-aa02930afc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:27.678660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 704/1406] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:27 2022] DELETE /identity/v3/projects/bdf3227ff2d243059363c56af7f0fa83 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:27.684691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.684978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.685246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.755393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:27.759876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.857114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 703/1407] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:27.858160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.860802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.901599 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 705/1408] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:27.902788 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:27.904290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:27.970731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981282c5-019f-4f8c-9a6c-1a22a8767968 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:27.977689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:27.978418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:27.978615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:27.978962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] PATH_INFO: `/v3/projects/1ef7d4b576a14ae9b2b47228252f2715` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:27.980865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef7d4b576a14ae9b2b47228252f2715)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:27.982985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.052926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ffd3-6404-4852-8e81-b9ce1a66f30d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.072098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3769cfb-723a-4db8-9fdf-ceedf7407203 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.072879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769cfb-723a-4db8-9fdf-ceedf7407203 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.073032 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769cfb-723a-4db8-9fdf-ceedf7407203 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.073299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3769cfb-723a-4db8-9fdf-ceedf7407203 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.079918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c3769cfb-723a-4db8-9fdf-ceedf7407203 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.111973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3769cfb-723a-4db8-9fdf-ceedf7407203 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.114125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3769cfb-723a-4db8-9fdf-ceedf7407203 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.151617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef7d4b576a14ae9b2b47228252f2715', 'request_id': 'req-d0624e96-406c-49b2-acfb-521af6b0cedd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.152077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 706/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:28.153638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.161768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.161768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.166909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef7d4b576a14ae9b2b47228252f2715', 'request_id': 'req-d0624e96-406c-49b2-acfb-521af6b0cedd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.178708 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef7d4b576a14ae9b2b47228252f2715', 'request_id': 'req-d0624e96-406c-49b2-acfb-521af6b0cedd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.209067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:28.212087 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.312273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 707/1410] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:28.322170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:28.326684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.356187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] The token cache is being invalidate because project 1ef7d4b576a14ae9b2b47228252f2715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:28.356713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.357841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.370459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 704/1411] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:27 2022] DELETE /identity/v3/projects/1ef7d4b576a14ae9b2b47228252f2715 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:28.374927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:28.382829 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.386861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e35e8-172c-47a4-bf42-d63d6ce2b274 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.425851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.425851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.425851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.425851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] PATH_INFO: `/v3/users/f50dece7381147768a7072fb26140927` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.426369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50dece7381147768a7072fb26140927)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.426369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.434986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0624e96-406c-49b2-acfb-521af6b0cedd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.456575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94518792-1f70-4de8-8494-570371afb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.457587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518792-1f70-4de8-8494-570371afb8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.458067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518792-1f70-4de8-8494-570371afb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.477497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94518792-1f70-4de8-8494-570371afb8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.480568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518792-1f70-4de8-8494-570371afb8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:28.481143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518792-1f70-4de8-8494-570371afb8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.492981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94518792-1f70-4de8-8494-570371afb8d2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.555538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 705/1412] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:28.560706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef474d31-2e09-4a26-9586-6c6626fe8503 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.561170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef474d31-2e09-4a26-9586-6c6626fe8503 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.561620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef474d31-2e09-4a26-9586-6c6626fe8503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.632046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ef474d31-2e09-4a26-9586-6c6626fe8503 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:28.642403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ef474d31-2e09-4a26-9586-6c6626fe8503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:28.676987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 706/1413] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:28.690734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef474d31-2e09-4a26-9586-6c6626fe8503 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:28.708883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef474d31-2e09-4a26-9586-6c6626fe8503 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:28.717378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510917e-2fc4-4340-82c0-e649888cff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:28.718214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510917e-2fc4-4340-82c0-e649888cff69 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.718700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510917e-2fc4-4340-82c0-e649888cff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.719184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510917e-2fc4-4340-82c0-e649888cff69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.720364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510917e-2fc4-4340-82c0-e649888cff69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:28.724299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510917e-2fc4-4340-82c0-e649888cff69 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:28.826703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50dece7381147768a7072fb26140927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.832089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50dece7381147768a7072fb26140927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.880729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50dece7381147768a7072fb26140927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.900298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50dece7381147768a7072fb26140927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:28.909454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 707/1414] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:28 2022] POST /identity/v3/projects => generated 405 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:28.918136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db657c-1b61-4b13-91fc-f423ca40e946 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:28.918958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db657c-1b61-4b13-91fc-f423ca40e946 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:28.919652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db657c-1b61-4b13-91fc-f423ca40e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:28.966822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a1db657c-1b61-4b13-91fc-f423ca40e946 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:28.969460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a1db657c-1b61-4b13-91fc-f423ca40e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.049392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50dece7381147768a7072fb26140927'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:29.065841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 708/1415] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:28 2022] DELETE /identity/v3/users/f50dece7381147768a7072fb26140927 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:29.070600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.080626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.140295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:29.179240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 708/1416] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:29.181964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519d024-ff0a-4552-95c3-362969b43a69 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.193387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519d024-ff0a-4552-95c3-362969b43a69 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.193387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519d024-ff0a-4552-95c3-362969b43a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.208975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8519d024-ff0a-4552-95c3-362969b43a69 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:29.210613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8519d024-ff0a-4552-95c3-362969b43a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.219663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 709/1417] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:29.221055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519d024-ff0a-4552-95c3-362969b43a69 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.227700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f24b5-2916-4d6e-a128-820528c3c468 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.236810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.237644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.238081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.238826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.240252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.243405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.247368 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519d024-ff0a-4552-95c3-362969b43a69 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.252722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.253334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.253656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.254076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.254974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:29.255274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.257772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.271099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 710/1418] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:29.272015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.274439 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.277513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:29.359226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 709/1419] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/users => generated 303 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:29.360147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.368108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de244ce-ef1f-4b2b-8736-2d228d71d277 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.372068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.372718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.373057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.373336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.385702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.387430 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.403566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 711/1420] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:29.403566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.409123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03772257-534f-4757-b770-f12f8d3b7b60 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.412892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0b41-751e-4ef1-918b-6f76d92d8c12 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.422331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.423160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.423444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.424285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.424729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.430381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.436011 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.436670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.436952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.442246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.443064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.450459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.468976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 712/1421] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:29.470466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.490105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99375be-14c9-483c-b3cf-3155aa62e3fd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.498869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.499491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.499984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.500208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.500967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.502791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.518640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 713/1422] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:29.519597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.541914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a60c5-a105-4170-875b-e9b18c263793 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.548137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38fcf6-a726-4dbf-8c61-dffdecfb9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:29.555724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38fcf6-a726-4dbf-8c61-dffdecfb9684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.556011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38fcf6-a726-4dbf-8c61-dffdecfb9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.556283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38fcf6-a726-4dbf-8c61-dffdecfb9684 admin admin] PATH_INFO: `/v3/projects/91df62f22dbb4411b66ba82b979edbbb/users/d518af5f15804cb084cc4da6ad00c4ab/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.611783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 710/1423] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:29.612766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:29.614892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38fcf6-a726-4dbf-8c61-dffdecfb9684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91df62f22dbb4411b66ba82b979edbbb, user_id=d518af5f15804cb084cc4da6ad00c4ab, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:29.626402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38fcf6-a726-4dbf-8c61-dffdecfb9684 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:29.794409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 714/1424] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:29 2022] PUT /identity/v3/projects/91df62f22dbb4411b66ba82b979edbbb/users/d518af5f15804cb084cc4da6ad00c4ab/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:29.794409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd045cc-9945-4df1-8d4f-09cac4096deb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.794409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd045cc-9945-4df1-8d4f-09cac4096deb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:29.794409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd045cc-9945-4df1-8d4f-09cac4096deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:29.843043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cbd045cc-9945-4df1-8d4f-09cac4096deb None None] MFA Rules not processed for user `6db9f53e5e204abfb8f89a041b8c26a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:29.844882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cbd045cc-9945-4df1-8d4f-09cac4096deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:29.883527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164bca0-773a-4cde-8f6a-c11b4a0ca201 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:29.982897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 715/1425] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:29.988239 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876947d-bac9-4e30-84d3-3c29bf17ed2d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:29.992801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876947d-bac9-4e30-84d3-3c29bf17ed2d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.000950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876947d-bac9-4e30-84d3-3c29bf17ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.026838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f876947d-bac9-4e30-84d3-3c29bf17ed2d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:30.028071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f876947d-bac9-4e30-84d3-3c29bf17ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.038490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.039473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.040029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.052600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.052600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.052800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.146363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 711/1426] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/users => generated 293 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:30.150822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.181469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51398fd-20fe-49a8-871f-2666a5a4d87b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.191522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 716/1427] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:30.215297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876947d-bac9-4e30-84d3-3c29bf17ed2d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.216286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.216286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.216286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.216286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.216709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.218252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.252810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 712/1428] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:30.257378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.320540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f8d53-525a-4d55-827e-242295c96b95 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.326134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.327131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.327638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.328459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.332122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.332122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.367869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 713/1429] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:30.375639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.411782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53366d54-fa8b-43e2-9b7c-f26865d2f289 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.425839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.427423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.427713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.427991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] PATH_INFO: `/v3/projects/048784ae7b47488fa883a4180ae0ed36/users/b82d933ef31c49f1afe76212838730cc/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.429698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876947d-bac9-4e30-84d3-3c29bf17ed2d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.439081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656aa76-e02b-46c2-a6de-dd3b65897cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.439708 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656aa76-e02b-46c2-a6de-dd3b65897cbc service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.439984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656aa76-e02b-46c2-a6de-dd3b65897cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.440256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656aa76-e02b-46c2-a6de-dd3b65897cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.461779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656aa76-e02b-46c2-a6de-dd3b65897cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.463489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656aa76-e02b-46c2-a6de-dd3b65897cbc service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.469190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=048784ae7b47488fa883a4180ae0ed36, user_id=b82d933ef31c49f1afe76212838730cc, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.476000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.490209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 717/1430] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:30.608593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 714/1431] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:30 2022] PUT /identity/v3/projects/048784ae7b47488fa883a4180ae0ed36/users/b82d933ef31c49f1afe76212838730cc/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:30.620066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.620466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.620818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.642516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.645229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.687636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] MFA Rules not processed for user `b82d933ef31c49f1afe76212838730cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:30.688749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.789050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bdc87-e4da-4073-bbf0-f2691385f82d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.807232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.807895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.808178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.809142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 718/1432] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:30.828528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] PATH_INFO: `/v3/projects/63e3e19516a7428692a9e4a17fe01f5d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.831601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e3e19516a7428692a9e4a17fe01f5d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.835710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:30.837479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:30.872822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:30.911053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:30.934036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aec6c-7ae9-4afe-9894-d4aa1fe3565f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:30.938384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:30.938810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:30.939088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:30.939361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:30.949584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:30.951068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.009498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 719/1433] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:31.093852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e3e19516a7428692a9e4a17fe01f5d', 'request_id': 'req-9d55077c-c782-4816-9826-6d54306c6a7d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.129852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e3e19516a7428692a9e4a17fe01f5d', 'request_id': 'req-9d55077c-c782-4816-9826-6d54306c6a7d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.148928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e3e19516a7428692a9e4a17fe01f5d', 'request_id': 'req-9d55077c-c782-4816-9826-6d54306c6a7d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.263486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] The token cache is being invalidate because project 63e3e19516a7428692a9e4a17fe01f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:31.263778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.271809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.275828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 715/1434] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:30 2022] DELETE /identity/v3/projects/63e3e19516a7428692a9e4a17fe01f5d => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:31.282166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:31.296920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d4826-eaf8-4075-949b-b5949f4ebbf7 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:31.440558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:31.447254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:31.447254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:31.447254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] PATH_INFO: `/v3/users/27a6d760a1ff4f9bb4522a7ca32baf76` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:31.447254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a6d760a1ff4f9bb4522a7ca32baf76)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:31.449382 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:31.821628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a6d760a1ff4f9bb4522a7ca32baf76'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.846859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a6d760a1ff4f9bb4522a7ca32baf76'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.849514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a6d760a1ff4f9bb4522a7ca32baf76'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.864952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a6d760a1ff4f9bb4522a7ca32baf76'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:31.918199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:31.980731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e908e1b0-2a66-4399-904a-8b67bba05e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a6d760a1ff4f9bb4522a7ca32baf76'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:32.001656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 720/1435] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:31 2022] DELETE /identity/v3/users/27a6d760a1ff4f9bb4522a7ca32baf76 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:32.122368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:32.124855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:32.336933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55077c-c782-4816-9826-6d54306c6a7d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:32.530600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:32.532672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.533379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.535061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.538949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:32.680216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:32.682005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:32.701165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 716/1436] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:32.797793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:32.798230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:32.798608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:32.863688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] MFA Rules not processed for user `d518af5f15804cb084cc4da6ad00c4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:32.866610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:32.998421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:33.027734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 721/1437] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:32 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:33.032636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.034170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:33.095404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.096963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:33.144945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcea565-86c3-43ed-8263-1587bc40e28c service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.150122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.150729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.151009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.151282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.151917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.153948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.197527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d79c5-8471-490e-97c3-efa2c8222c42 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.202261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.202892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.203167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.209149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] PATH_INFO: `/v3/projects/4a543b81ef5445399880b7d910368518` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.209149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a543b81ef5445399880b7d910368518)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.209149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.345677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 717/1438] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/projects => generated 405 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:33.346846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.364195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a543b81ef5445399880b7d910368518', 'request_id': 'req-63d3cb86-152b-4407-bb9d-5007df357e61'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:33.371293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a543b81ef5445399880b7d910368518', 'request_id': 'req-63d3cb86-152b-4407-bb9d-5007df357e61'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:33.378284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a543b81ef5445399880b7d910368518', 'request_id': 'req-63d3cb86-152b-4407-bb9d-5007df357e61'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:33.420926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88881bd-f708-486c-b484-a1c735cd1779 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.425817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27b96-57a0-475a-a0e2-6ad8b1c042b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.426419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27b96-57a0-475a-a0e2-6ad8b1c042b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.426693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27b96-57a0-475a-a0e2-6ad8b1c042b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.427389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27b96-57a0-475a-a0e2-6ad8b1c042b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.428017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27b96-57a0-475a-a0e2-6ad8b1c042b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.430706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27b96-57a0-475a-a0e2-6ad8b1c042b5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.509752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] The token cache is being invalidate because project 4a543b81ef5445399880b7d910368518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:33.509752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:33.509752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-63d3cb86-152b-4407-bb9d-5007df357e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:33.510454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 722/1439] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:33 2022] DELETE /identity/v3/projects/4a543b81ef5445399880b7d910368518 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:33.522716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef597f-5989-4a23-a973-b33df160790c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.523254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef597f-5989-4a23-a973-b33df160790c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.523535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef597f-5989-4a23-a973-b33df160790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.548842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0eef597f-5989-4a23-a973-b33df160790c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:33.550140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0eef597f-5989-4a23-a973-b33df160790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:33.561624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 723/1440] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:33.564874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 718/1441] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/users => generated 309 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:33.568905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef597f-5989-4a23-a973-b33df160790c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.571115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0eef597f-5989-4a23-a973-b33df160790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:33.573401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23cea-82ca-4d15-982a-280c31eb547d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.573705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23cea-82ca-4d15-982a-280c31eb547d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.573980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23cea-82ca-4d15-982a-280c31eb547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.584570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef597f-5989-4a23-a973-b33df160790c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.589730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.590344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.590839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.591121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.591967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.593701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.607000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 724/1442] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:33.613260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-18e23cea-82ca-4d15-982a-280c31eb547d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:33.613883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.616638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-18e23cea-82ca-4d15-982a-280c31eb547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:33.645335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be866cd-8bca-4580-a326-aca7e4f6802e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.650034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 719/1443] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:33.654694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23cea-82ca-4d15-982a-280c31eb547d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.660519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.661668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.663472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.664073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] PATH_INFO: `/v3/projects/959d1514763e4d03a41cee4dfcb99a5f/users/fbb75530a6db45ac869d7727efe383bd/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.673170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23cea-82ca-4d15-982a-280c31eb547d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.680879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.689044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.689044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.689044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.689044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:33.689044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.689044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.689784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959d1514763e4d03a41cee4dfcb99a5f, user_id=fbb75530a6db45ac869d7727efe383bd, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.692128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.699596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 720/1444] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:33.703972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.719020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cb5f-5970-42ba-a497-2263199bcc9b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.724687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.726101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.726545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.726874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.727514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.729621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:33.774336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 725/1445] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:33 2022] PUT /identity/v3/projects/959d1514763e4d03a41cee4dfcb99a5f/users/fbb75530a6db45ac869d7727efe383bd/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:33.778470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.830008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 721/1446] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:33.840543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:33.896183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c0fa-bf13-45a4-8d9d-e47d93c11fe4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.971595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d123f5-0235-4805-a967-904e71d95071 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:33.987864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:33.988625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:33.989565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:33.989907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:33.991210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:33.994412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.048178 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.048887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.053483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.053483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.053483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.053483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.063142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 726/1447] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:34.069554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.081452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5b25e-a358-49dc-9a52-80205452f03c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.086888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.087646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.087988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.088340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] PATH_INFO: `/v3/projects/959d1514763e4d03a41cee4dfcb99a5f/users/fbb75530a6db45ac869d7727efe383bd/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.090621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959d1514763e4d03a41cee4dfcb99a5f, user_id=fbb75530a6db45ac869d7727efe383bd, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.093574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.120970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 727/1448] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:34 2022] PUT /identity/v3/projects/959d1514763e4d03a41cee4dfcb99a5f/users/fbb75530a6db45ac869d7727efe383bd/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:34.157123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 722/1449] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:33 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:34.158787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.255360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5c329-4820-4912-9726-b3c933fe5d14 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.260305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.260964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.261321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.261501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.262461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.263804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.275263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 728/1450] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:34.279475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.291575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b4769-8214-4116-bb88-7d2b7d909f3e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.297443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f01c5-4c1c-4476-9aaa-5fdba35b9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.298216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f01c5-4c1c-4476-9aaa-5fdba35b9cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.298673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f01c5-4c1c-4476-9aaa-5fdba35b9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.299341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f01c5-4c1c-4476-9aaa-5fdba35b9cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.300371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f01c5-4c1c-4476-9aaa-5fdba35b9cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.302208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f01c5-4c1c-4476-9aaa-5fdba35b9cd6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.328861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.329338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 723/1451] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:34.345735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00827278-1c40-4622-97b2-3e01d651ea44 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.354682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8177a-9924-446b-9b27-155110251807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.355649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8177a-9924-446b-9b27-155110251807 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.356179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8177a-9924-446b-9b27-155110251807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.356860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8177a-9924-446b-9b27-155110251807 admin admin] PATH_INFO: `/v3/projects/bd8705a940ef473c83e74508885e29ef/users/932eef7f90c947d29af7cd41a0a725ba/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.379928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8177a-9924-446b-9b27-155110251807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8705a940ef473c83e74508885e29ef, user_id=932eef7f90c947d29af7cd41a0a725ba, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.385375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8177a-9924-446b-9b27-155110251807 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.432995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339a8b-6bdc-4451-85c9-2e7c48852b64 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.434062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339a8b-6bdc-4451-85c9-2e7c48852b64 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.438564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29339a8b-6bdc-4451-85c9-2e7c48852b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.473876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 729/1452] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:34 2022] PUT /identity/v3/projects/bd8705a940ef473c83e74508885e29ef/users/932eef7f90c947d29af7cd41a0a725ba/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:34.488367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767abb1f-28d1-4377-9bf1-cd2266752a16 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.488923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767abb1f-28d1-4377-9bf1-cd2266752a16 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.489206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767abb1f-28d1-4377-9bf1-cd2266752a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.536560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-29339a8b-6bdc-4451-85c9-2e7c48852b64 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:34.539796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-29339a8b-6bdc-4451-85c9-2e7c48852b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:34.550715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-767abb1f-28d1-4377-9bf1-cd2266752a16 None None] MFA Rules not processed for user `932eef7f90c947d29af7cd41a0a725ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:34.551998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-767abb1f-28d1-4377-9bf1-cd2266752a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:34.671681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 724/1453] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:41:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:34.686306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 730/1454] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:34.690717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29339a8b-6bdc-4451-85c9-2e7c48852b64 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.780663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29339a8b-6bdc-4451-85c9-2e7c48852b64 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.786291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.787294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.787294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.787522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.788058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.790060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:34.903456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 725/1455] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:34 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:34.904702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767abb1f-28d1-4377-9bf1-cd2266752a16 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:34.916117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767abb1f-28d1-4377-9bf1-cd2266752a16 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:34.990374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:34.991686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:34.992105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:34.992867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:34.993641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:34.996309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.075191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.077492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:35.138018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 731/1456] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:34 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:35.142794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.200235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63446cdb-990d-48ff-b85b-f7886c1c24b3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:35.213704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:35.215333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.217059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.217340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.217992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:35.221600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.258030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 732/1457] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:35.264072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.309753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39b706-474f-40ec-bb08-6b95a437e7a5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:35.318935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:35.318935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.319446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.319853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] PATH_INFO: `/v3/projects/bb3033cf8eaf41d6a162536f89f6f495/users/819da92b8f3340959c7949c1bfde691a/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.340163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3033cf8eaf41d6a162536f89f6f495, user_id=819da92b8f3340959c7949c1bfde691a, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:35.347588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.396669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde642ee-d433-405d-b994-0bbfe8fb0b4d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:35.406345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:35.413137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.414391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.414831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.437018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 733/1458] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:35 2022] PUT /identity/v3/projects/bb3033cf8eaf41d6a162536f89f6f495/users/819da92b8f3340959c7949c1bfde691a/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:35.438580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.511573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:35.513589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.525532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:35.558193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 726/1459] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:41:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:41:35.579149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8475b-f171-4c64-928c-86e23672bb6f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:35.624284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc53a9-50da-4695-8f00-dde75b254acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:35.625117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc53a9-50da-4695-8f00-dde75b254acb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.625390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc53a9-50da-4695-8f00-dde75b254acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.625657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc53a9-50da-4695-8f00-dde75b254acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.626309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc53a9-50da-4695-8f00-dde75b254acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:35.628273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc53a9-50da-4695-8f00-dde75b254acb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.651771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 734/1460] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:35.659027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.693065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02c3c-bd43-4661-a1c8-6d34bb32db74 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:35.715116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:35.715960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.716252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.716529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] PATH_INFO: `/v3/projects/bb3033cf8eaf41d6a162536f89f6f495/users/819da92b8f3340959c7949c1bfde691a/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.722861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3033cf8eaf41d6a162536f89f6f495, user_id=819da92b8f3340959c7949c1bfde691a, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:35.731242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:35.764484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 727/1461] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:35 2022] PUT /identity/v3/projects/bb3033cf8eaf41d6a162536f89f6f495/users/819da92b8f3340959c7949c1bfde691a/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:35.769979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8de2-00cf-4fdb-812f-5d8d6b085a92 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:35.770169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8de2-00cf-4fdb-812f-5d8d6b085a92 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:35.770531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8de2-00cf-4fdb-812f-5d8d6b085a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:35.814088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-77ca8de2-00cf-4fdb-812f-5d8d6b085a92 None None] MFA Rules not processed for user `819da92b8f3340959c7949c1bfde691a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:35.815335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-77ca8de2-00cf-4fdb-812f-5d8d6b085a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:35.950515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 735/1462] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:35.963169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:35.966059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:36.075433 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:36.075899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:36.076321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:36.167512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] MFA Rules not processed for user `60e4cc87886d4b7788864eaf94334e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:36.169730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:36.172262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e5a71-c250-45a0-8abe-68ed939b9aab admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:36.176874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3849-afa1-4630-8752-53cf40f05443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:36.177934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3849-afa1-4630-8752-53cf40f05443 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:36.178984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3849-afa1-4630-8752-53cf40f05443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:36.179435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3849-afa1-4630-8752-53cf40f05443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:36.193400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3849-afa1-4630-8752-53cf40f05443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:36.195032 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3849-afa1-4630-8752-53cf40f05443 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:36.282422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 728/1463] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:36.336559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 736/1464] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Nov 2 07:41:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:36.601263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:36.666008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:36.752694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8322a5-0f17-45b7-9693-fcaf972b4ff5 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:36.753108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8322a5-0f17-45b7-9693-fcaf972b4ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:36.753517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8322a5-0f17-45b7-9693-fcaf972b4ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:36.846694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7f8322a5-0f17-45b7-9693-fcaf972b4ff5 None None] MFA Rules not processed for user `fbb75530a6db45ac869d7727efe383bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:36.847989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7f8322a5-0f17-45b7-9693-fcaf972b4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:36.919997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:36.921865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:36.941225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c582df-8a51-4d03-b9e5-6d41194ed1a5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:36.957269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:36.962259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:36.962906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:36.963516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:36.999551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:37.005518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:37.041481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 737/1465] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:37.055995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 729/1466] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:37.785339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:38.255209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:38.278694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aeb24-3b7a-44dc-9667-db9d91808f85 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:38.295291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819da92b8f3340959c7949c1bfde691a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb3033cf8eaf41d6a162536f89f6f495', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:38.301860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.301860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.301860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.301860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:38.301860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:38.302199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:38.322024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 738/1467] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:38.330857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8322a5-0f17-45b7-9693-fcaf972b4ff5 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:38.363650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8322a5-0f17-45b7-9693-fcaf972b4ff5 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:38.377674 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819da92b8f3340959c7949c1bfde691a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb3033cf8eaf41d6a162536f89f6f495', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:38.379012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.379988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.382702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.384802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:38.387835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:38.711791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 730/1468] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:38 2022] POST /identity/v3/projects => generated 353 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:38.728152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:38.745082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d394cc-5fa0-46b5-9a5c-990216c95a69 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:38.858163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db87d9-4769-459b-88d4-59dc69146b74 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819da92b8f3340959c7949c1bfde691a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb3033cf8eaf41d6a162536f89f6f495', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:38.858805 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db87d9-4769-459b-88d4-59dc69146b74 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:38.859102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db87d9-4769-459b-88d4-59dc69146b74 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:38.859366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db87d9-4769-459b-88d4-59dc69146b74 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:38.860028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db87d9-4769-459b-88d4-59dc69146b74 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:38.860485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db87d9-4769-459b-88d4-59dc69146b74 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:38.873411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db87d9-4769-459b-88d4-59dc69146b74 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:38.897115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 739/1469] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:38.972468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:39.136182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:39.152774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57183c5-0697-4c34-ade8-c14abff3024e tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:39.154400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6a03-efdc-4bb2-81b7-5538c0f3a1a0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:39.154795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6a03-efdc-4bb2-81b7-5538c0f3a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:39.155527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6a03-efdc-4bb2-81b7-5538c0f3a1a0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:39.158058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 740/1470] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:41:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:39.165880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3ace-cd00-4e71-a885-d686a6659d73 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:39.166395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3ace-cd00-4e71-a885-d686a6659d73 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:39.166861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3ace-cd00-4e71-a885-d686a6659d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:39.167784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819da92b8f3340959c7949c1bfde691a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb3033cf8eaf41d6a162536f89f6f495', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:39.168417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:39.169038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:39.169459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] PATH_INFO: `/v3/projects/f03b26ce4a1843f38a0f3be9e16628f6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:39.172461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f03b26ce4a1843f38a0f3be9e16628f6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:39.176533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:39.216161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d2fd3ace-cd00-4e71-a885-d686a6659d73 None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:39.217585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d2fd3ace-cd00-4e71-a885-d686a6659d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:39.363736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 741/1471] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:41:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:39.390621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6f69-211c-40e4-96c4-55f2d1be3fe6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:39.391026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6f69-211c-40e4-96c4-55f2d1be3fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:39.391440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6f69-211c-40e4-96c4-55f2d1be3fe6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:39.395714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 742/1472] 10.222.0.39 () {54 vars in 961 bytes} [Wed Nov 2 07:41:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:39.401282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038d4e2-dcfe-4ed8-95e1-eb0264e74b1b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:39.401670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038d4e2-dcfe-4ed8-95e1-eb0264e74b1b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:39.402163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038d4e2-dcfe-4ed8-95e1-eb0264e74b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:39.411454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f03b26ce4a1843f38a0f3be9e16628f6', 'request_id': 'req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:39.424223 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f03b26ce4a1843f38a0f3be9e16628f6', 'request_id': 'req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:39.442471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f03b26ce4a1843f38a0f3be9e16628f6', 'request_id': 'req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:39.455701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e038d4e2-dcfe-4ed8-95e1-eb0264e74b1b None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:39.457523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e038d4e2-dcfe-4ed8-95e1-eb0264e74b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:39.555502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] The token cache is being invalidate because project f03b26ce4a1843f38a0f3be9e16628f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:39.555828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:39.557158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:39.569558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 731/1473] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:39 2022] DELETE /identity/v3/projects/f03b26ce4a1843f38a0f3be9e16628f6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:39.639369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 743/1474] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Nov 2 07:41:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:39.648396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:39.669974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342eefd-c726-4ba2-ae7e-5ca33fb59a48 tempest-VolumeQuotaClassesTest-919430599 tempest-VolumeQuotaClassesTest-919430599-project-admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:39.696002 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e4ebb-885b-4d70-a2dd-ee66c9e03d61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:39.696798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4ebb-885b-4d70-a2dd-ee66c9e03d61 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:39.697081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4ebb-885b-4d70-a2dd-ee66c9e03d61 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:39.697355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4ebb-885b-4d70-a2dd-ee66c9e03d61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:39.702267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-303e4ebb-885b-4d70-a2dd-ee66c9e03d61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:39.728646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e4ebb-885b-4d70-a2dd-ee66c9e03d61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:39.730460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e4ebb-885b-4d70-a2dd-ee66c9e03d61 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:39.746910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 732/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:40.508990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af31874-21c3-42b9-8025-0f11638a22fb None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:40.510856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af31874-21c3-42b9-8025-0f11638a22fb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:40.511396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af31874-21c3-42b9-8025-0f11638a22fb None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:40.514056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 744/1476] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:41:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:40.523604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:40.525089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:40.525733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:40.570881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:40.573762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:40.730463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 733/1477] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:41:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:40.756465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af31874-21c3-42b9-8025-0f11638a22fb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:40.758557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6af31874-21c3-42b9-8025-0f11638a22fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:40.798398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af31874-21c3-42b9-8025-0f11638a22fb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:40.815955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:40.816855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:40.817297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:40.817837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:40.833446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:40.836140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:40.869779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 745/1478] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:40.921370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:41.282173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:41.284866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:41.481453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386303e5-c166-427d-b6ad-bb91db292648 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:41.490543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:41.491195 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:41.491475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:41.492471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] PATH_INFO: `/v3/users/932eef7f90c947d29af7cd41a0a725ba` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:41.499093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932eef7f90c947d29af7cd41a0a725ba)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:41.501722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:41.608492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:41.610051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:41.632098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72d664-efb1-4f30-98b7-70c771dc0992 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:41.652158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:41.652158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:41.652158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:41.652158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] PATH_INFO: `/v3/users/d518af5f15804cb084cc4da6ad00c4ab` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:41.652520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d518af5f15804cb084cc4da6ad00c4ab)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:41.652520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:41.919123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932eef7f90c947d29af7cd41a0a725ba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.925378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932eef7f90c947d29af7cd41a0a725ba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:41.964913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932eef7f90c947d29af7cd41a0a725ba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.000337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932eef7f90c947d29af7cd41a0a725ba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.002602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd518af5f15804cb084cc4da6ad00c4ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.022243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd518af5f15804cb084cc4da6ad00c4ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.025003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd518af5f15804cb084cc4da6ad00c4ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.026595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd518af5f15804cb084cc4da6ad00c4ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.160236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3975461c-d36d-4ff3-bf0e-17f702634131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932eef7f90c947d29af7cd41a0a725ba'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.175820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 734/1479] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:41 2022] DELETE /identity/v3/users/932eef7f90c947d29af7cd41a0a725ba => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:42.179922 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:42.180565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:42.180858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:42.217244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:42.220070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:42.247380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd518af5f15804cb084cc4da6ad00c4ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:42.300085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 746/1480] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:41 2022] DELETE /identity/v3/users/d518af5f15804cb084cc4da6ad00c4ab => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:42.341031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 735/1481] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:42.387580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:42.387580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:42.471270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1446c4-a0a0-4e50-bf84-ca3239dfadbb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:42.492733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:42.492954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:42.493124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:42.493399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:42.572323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:42.573885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:42.587495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 747/1482] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:42.761584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:43.793965 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.795427 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.814247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6eaa-fe6c-4198-a5c3-24539d9f5b13 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.822966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:43.824353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:43.825061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:43.825828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] PATH_INFO: `/v3/users/b82d933ef31c49f1afe76212838730cc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:43.827773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82d933ef31c49f1afe76212838730cc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:43.845125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:43.950601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:43.952157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:43.974645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c00049-c776-402d-bc80-9c5643debd7e service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:43.994508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:44.005600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:44.005600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:44.005600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] PATH_INFO: `/v3/projects/91df62f22dbb4411b66ba82b979edbbb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:44.005600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91df62f22dbb4411b66ba82b979edbbb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:44.005600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:44.668687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91df62f22dbb4411b66ba82b979edbbb', 'request_id': 'req-d6fe20fa-3d3c-4f24-8972-bee802cc3096'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.678460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82d933ef31c49f1afe76212838730cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.679381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82d933ef31c49f1afe76212838730cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.682788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91df62f22dbb4411b66ba82b979edbbb', 'request_id': 'req-d6fe20fa-3d3c-4f24-8972-bee802cc3096'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.706465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91df62f22dbb4411b66ba82b979edbbb', 'request_id': 'req-d6fe20fa-3d3c-4f24-8972-bee802cc3096'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.710075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82d933ef31c49f1afe76212838730cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.719408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82d933ef31c49f1afe76212838730cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.913631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] The token cache is being invalidate because project 91df62f22dbb4411b66ba82b979edbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:44.922644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.922644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:44.922644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 748/1483] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:43 2022] DELETE /identity/v3/projects/91df62f22dbb4411b66ba82b979edbbb => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:44.922644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:44.929967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:45.092385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe20fa-3d3c-4f24-8972-bee802cc3096 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:45.097737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:45.098447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:45.098934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:45.099358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] PATH_INFO: `/v3/projects/bd8705a940ef473c83e74508885e29ef` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:45.101230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8705a940ef473c83e74508885e29ef)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:45.103155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:45.110435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82d933ef31c49f1afe76212838730cc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.125895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 736/1484] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:43 2022] DELETE /identity/v3/users/b82d933ef31c49f1afe76212838730cc => generated 0 bytes in 1329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:45.127272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:45.133496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:45.214779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43f6fd-102a-4ab7-8d30-d79945cd8cc3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:45.219799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:45.220447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:45.220799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:45.221172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] PATH_INFO: `/v3/users/fbb75530a6db45ac869d7727efe383bd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:45.222329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb75530a6db45ac869d7727efe383bd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:45.224260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:45.252592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8705a940ef473c83e74508885e29ef', 'request_id': 'req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.259866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8705a940ef473c83e74508885e29ef', 'request_id': 'req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.268386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8705a940ef473c83e74508885e29ef', 'request_id': 'req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.418150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] The token cache is being invalidate because project bd8705a940ef473c83e74508885e29ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:45.418265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.424902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddbef5c8-1921-4fb3-b356-0fe3d0be62c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.426727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 749/1485] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:44 2022] DELETE /identity/v3/projects/bd8705a940ef473c83e74508885e29ef => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:45.428116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:45.428587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:45.429107 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:45.449874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:45.451347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:45.587171 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 750/1486] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:45.588203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:45.593921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:45.608651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc71be9-280a-49e6-915d-6464605b433d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:45.620859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:45.621549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:45.621829 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:45.622499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] PATH_INFO: `/v3/users/819da92b8f3340959c7949c1bfde691a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:45.641494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819da92b8f3340959c7949c1bfde691a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:45.641494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:45.868325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb75530a6db45ac869d7727efe383bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.869193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb75530a6db45ac869d7727efe383bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.882908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb75530a6db45ac869d7727efe383bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:45.891818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb75530a6db45ac869d7727efe383bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.100897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819da92b8f3340959c7949c1bfde691a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.105429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb75530a6db45ac869d7727efe383bd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.112615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819da92b8f3340959c7949c1bfde691a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.113518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 737/1487] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:45 2022] DELETE /identity/v3/users/fbb75530a6db45ac869d7727efe383bd => generated 0 bytes in 987 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:46.114128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:46.116267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:46.117679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819da92b8f3340959c7949c1bfde691a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.119263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819da92b8f3340959c7949c1bfde691a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.221540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2613da-8304-4a75-9749-7e97839e07cf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:46.226868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b54990-e1e1-48c9-9229-5c888e1b3b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:46.227551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54990-e1e1-48c9-9229-5c888e1b3b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:46.227862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54990-e1e1-48c9-9229-5c888e1b3b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:46.228353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54990-e1e1-48c9-9229-5c888e1b3b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:46.230254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-05b54990-e1e1-48c9-9229-5c888e1b3b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:46.234218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819da92b8f3340959c7949c1bfde691a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.268395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 751/1488] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:45 2022] DELETE /identity/v3/users/819da92b8f3340959c7949c1bfde691a => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:46.366928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b54990-e1e1-48c9-9229-5c888e1b3b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:46.368279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b54990-e1e1-48c9-9229-5c888e1b3b04 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:46.378524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 738/1489] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:46.504180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:46.506724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:46.589566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5a52-b26a-49d8-9dc4-37b800b40617 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:46.594503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:46.595166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:46.595446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:46.595718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] PATH_INFO: `/v3/projects/959d1514763e4d03a41cee4dfcb99a5f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:46.596904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=959d1514763e4d03a41cee4dfcb99a5f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:46.598890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:46.870751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959d1514763e4d03a41cee4dfcb99a5f', 'request_id': 'req-4f4f6442-a5af-4d79-9edd-173eecc555a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.878555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959d1514763e4d03a41cee4dfcb99a5f', 'request_id': 'req-4f4f6442-a5af-4d79-9edd-173eecc555a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:46.887702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959d1514763e4d03a41cee4dfcb99a5f', 'request_id': 'req-4f4f6442-a5af-4d79-9edd-173eecc555a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.028969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] The token cache is being invalidate because project 959d1514763e4d03a41cee4dfcb99a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:47.028969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.028969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4f4f6442-a5af-4d79-9edd-173eecc555a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.028969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 752/1490] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:46 2022] DELETE /identity/v3/projects/959d1514763e4d03a41cee4dfcb99a5f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:47.029670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12bcf2-4c80-47d9-9f5c-6557bc3434fa None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.029670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12bcf2-4c80-47d9-9f5c-6557bc3434fa None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.029670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12bcf2-4c80-47d9-9f5c-6557bc3434fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.048248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6e12bcf2-4c80-47d9-9f5c-6557bc3434fa None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:47.049479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6e12bcf2-4c80-47d9-9f5c-6557bc3434fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.132080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 739/1491] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:47.139788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee9f3-c0a7-4f5f-b86d-e84ff763b38c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.140479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee9f3-c0a7-4f5f-b86d-e84ff763b38c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.140479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaee9f3-c0a7-4f5f-b86d-e84ff763b38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.162440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-aaaee9f3-c0a7-4f5f-b86d-e84ff763b38c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:47.163912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aaaee9f3-c0a7-4f5f-b86d-e84ff763b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.172139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 753/1492] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:47.181528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12bcf2-4c80-47d9-9f5c-6557bc3434fa None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.191974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12bcf2-4c80-47d9-9f5c-6557bc3434fa None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.197640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.198302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.198680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.198953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.199659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:47.199952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.201678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.214462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 740/1493] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:47.224090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaee9f3-c0a7-4f5f-b86d-e84ff763b38c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.235203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaee9f3-c0a7-4f5f-b86d-e84ff763b38c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.240096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.241381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.241661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.241931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.242585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.244683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.363759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.369923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.380103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df3ebc-bea0-404f-98ac-6fba2ad6435c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.386608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.395137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.395137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.395137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] PATH_INFO: `/v3/projects/048784ae7b47488fa883a4180ae0ed36` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.395137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=048784ae7b47488fa883a4180ae0ed36)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.395137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.437672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 754/1494] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:47.438605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.440269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:47.513330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a50e52-8abf-43a9-92b9-4c542584d6a9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:47.519613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:47.520511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:47.520944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:47.521914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] PATH_INFO: `/v3/projects/bb3033cf8eaf41d6a162536f89f6f495` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:47.535263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3033cf8eaf41d6a162536f89f6f495)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:47.539817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:47.584458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048784ae7b47488fa883a4180ae0ed36', 'request_id': 'req-9f36af49-9123-47ad-826c-1b1a632135b4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.592626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048784ae7b47488fa883a4180ae0ed36', 'request_id': 'req-9f36af49-9123-47ad-826c-1b1a632135b4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.601334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048784ae7b47488fa883a4180ae0ed36', 'request_id': 'req-9f36af49-9123-47ad-826c-1b1a632135b4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.921953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3033cf8eaf41d6a162536f89f6f495', 'request_id': 'req-66673769-1ec9-4f70-95e3-4849e6f24a82'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.927340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3033cf8eaf41d6a162536f89f6f495', 'request_id': 'req-66673769-1ec9-4f70-95e3-4849e6f24a82'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.933602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3033cf8eaf41d6a162536f89f6f495', 'request_id': 'req-66673769-1ec9-4f70-95e3-4849e6f24a82'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.941703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] The token cache is being invalidate because project 048784ae7b47488fa883a4180ae0ed36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:47.941987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.942646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:47.944736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 741/1495] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:47 2022] DELETE /identity/v3/projects/048784ae7b47488fa883a4180ae0ed36 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:47.947454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:47.947454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.023900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36af49-9123-47ad-826c-1b1a632135b4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.083072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] The token cache is being invalidate because project bb3033cf8eaf41d6a162536f89f6f495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:48.083381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:48.084613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66673769-1ec9-4f70-95e3-4849e6f24a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:48.086319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 755/1496] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:47 2022] DELETE /identity/v3/projects/bb3033cf8eaf41d6a162536f89f6f495 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:48.087437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995bbba-f448-4e8e-8287-05e4e0a923a0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.087782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995bbba-f448-4e8e-8287-05e4e0a923a0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.087981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995bbba-f448-4e8e-8287-05e4e0a923a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.094930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.095731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.096003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.097212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.098042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.100014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.109005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b995bbba-f448-4e8e-8287-05e4e0a923a0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.110389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b995bbba-f448-4e8e-8287-05e4e0a923a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.123341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 756/1497] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:48.126071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f306da-78b0-4b0c-8d27-9f404cbe1469 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.129397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f306da-78b0-4b0c-8d27-9f404cbe1469 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.129397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f306da-78b0-4b0c-8d27-9f404cbe1469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.147714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c1f306da-78b0-4b0c-8d27-9f404cbe1469 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.148921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c1f306da-78b0-4b0c-8d27-9f404cbe1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.157283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 757/1498] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:48.158464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4573016-0ead-4e0c-b9fe-03b58052b924 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.158749 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4573016-0ead-4e0c-b9fe-03b58052b924 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.159021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4573016-0ead-4e0c-b9fe-03b58052b924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.178044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a4573016-0ead-4e0c-b9fe-03b58052b924 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.179146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a4573016-0ead-4e0c-b9fe-03b58052b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.186887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 758/1499] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:48.188042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d46af-3c2a-4b7f-8b02-22418496e531 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.188327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d46af-3c2a-4b7f-8b02-22418496e531 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.188703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d46af-3c2a-4b7f-8b02-22418496e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.207554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-600d46af-3c2a-4b7f-8b02-22418496e531 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.209338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-600d46af-3c2a-4b7f-8b02-22418496e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.216908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 759/1500] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:48.217649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d46af-3c2a-4b7f-8b02-22418496e531 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.230035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d46af-3c2a-4b7f-8b02-22418496e531 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.231357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.231938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.232216 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.232511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.233150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:48.233451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.235034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.247000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 760/1501] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:48.247776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.257820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03096-863e-449d-b53f-43a274f04941 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.262302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.262862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.263140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.263409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.264025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:48.264324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.265921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.277527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 761/1502] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:41:48.278450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.284169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 742/1503] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:47 2022] POST /identity/v3/users => generated 287 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:48.285065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.290886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6fd6-54a3-4499-90eb-8802bacf9ec4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.294602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e4085-80c1-4b53-a7fa-adbae32ef4e1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.295432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.296018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.296294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.296596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.297251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.299130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.299744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.300398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.300846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.306990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.306990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.306990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.432723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 743/1504] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:48.439010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 762/1505] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:48.439141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.439141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:48.439326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.507996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a6da2-847b-4af2-94f2-507aac2ca249 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.521835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.522485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.522837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.523108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.524800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.525813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc16258-7904-45cc-8838-e25b2ce6574e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.526858 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.531651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.532350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.533164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.533164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.534463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.536921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.549348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 744/1506] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.549348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.562640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5662ed-3439-4613-b075-b9bc2f03b019 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.567224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.567804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.568675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.568949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.569613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.571482 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.692203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 763/1507] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:48.692405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 745/1508] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:48.695773 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.697650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.701426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d4fc-7ef3-4cf5-bab6-8ccf2b8934f1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.706784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.707391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.707667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.707943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.708649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab897e6a-c414-4370-bb1e-befeaeb13645 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.708784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.710195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.714121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.714826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.715198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.716030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.716982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.720812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.720939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 764/1509] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.721391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.731618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83406743-56d5-4f11-beac-46b21af861f6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.745559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 746/1510] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.745559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.745788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.745788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.745788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.745788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.746115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.746115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.750319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5355f6-0eeb-4fd6-969b-1bba1bbe7833 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.752490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 765/1511] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.753328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.756054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.756902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.757335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.757751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] PATH_INFO: `/v3/projects/07322de7bf454c0c91e6d8780617be53/users/a2d360678cfa49ad8299da148c97b714/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.762975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57638-9d51-48c4-9c2b-47a1f426143b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.767806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.768403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.768714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.768985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.769712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.771318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.779507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07322de7bf454c0c91e6d8780617be53, user_id=a2d360678cfa49ad8299da148c97b714, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.782464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.783196 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 766/1512] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.787784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.798017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163b4d8-c085-43b7-a9a3-8c5031ee1c7f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.803462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.804076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.804602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.812596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.812596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:48.812596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.812596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.819350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 767/1513] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:48.820152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.829725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d37be1-0aa7-4b6c-b115-359c8ae60ab1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:48.834702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4798e0-0f3a-4cd2-91a4-111329c71a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:48.835351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4798e0-0f3a-4cd2-91a4-111329c71a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.837009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4798e0-0f3a-4cd2-91a4-111329c71a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.837009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4798e0-0f3a-4cd2-91a4-111329c71a58 admin admin] PATH_INFO: `/v3/projects/53f03fa2ae254b2fb0f567cd6ae18465/users/6820fc8ca3994f5d860631f6cbbeb4d3/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.857190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4798e0-0f3a-4cd2-91a4-111329c71a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f03fa2ae254b2fb0f567cd6ae18465, user_id=6820fc8ca3994f5d860631f6cbbeb4d3, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:48.857190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4798e0-0f3a-4cd2-91a4-111329c71a58 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:48.924224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 747/1514] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:48 2022] PUT /identity/v3/projects/07322de7bf454c0c91e6d8780617be53/users/a2d360678cfa49ad8299da148c97b714/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:48.924224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:48.950323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:48.950430 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 768/1515] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:48 2022] PUT /identity/v3/projects/53f03fa2ae254b2fb0f567cd6ae18465/users/6820fc8ca3994f5d860631f6cbbeb4d3/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:48.960319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26707-fa33-4e06-ad89-0563bd4132f8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:48.960649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26707-fa33-4e06-ad89-0563bd4132f8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:48.961016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e26707-fa33-4e06-ad89-0563bd4132f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:48.996668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-30e26707-fa33-4e06-ad89-0563bd4132f8 None None] MFA Rules not processed for user `a2d360678cfa49ad8299da148c97b714`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:48.998076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-30e26707-fa33-4e06-ad89-0563bd4132f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.013398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d01e0d-da54-4928-a5f0-9fbf30e2a14b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.071731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 769/1516] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:49.073018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe4280-e42f-463a-975b-48ded70128b5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.073326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe4280-e42f-463a-975b-48ded70128b5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.073573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe4280-e42f-463a-975b-48ded70128b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.082435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.083171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.083517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.084369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] PATH_INFO: `/v3/projects/a3373147a7f44462bd4d354d58686b63/users/efba8929340f441196d06d62814403c1/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.100345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3373147a7f44462bd4d354d58686b63, user_id=efba8929340f441196d06d62814403c1, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.102295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c2fe4280-e42f-463a-975b-48ded70128b5 None None] MFA Rules not processed for user `6820fc8ca3994f5d860631f6cbbeb4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:49.103136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.103501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c2fe4280-e42f-463a-975b-48ded70128b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.172577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 770/1517] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:49.173399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe4280-e42f-463a-975b-48ded70128b5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.185166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe4280-e42f-463a-975b-48ded70128b5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.191420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 748/1518] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:48 2022] PUT /identity/v3/projects/a3373147a7f44462bd4d354d58686b63/users/efba8929340f441196d06d62814403c1/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:49.195268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.254816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6a59-09b8-4802-b748-82ff627fddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.255348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6a59-09b8-4802-b748-82ff627fddd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.255656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6a59-09b8-4802-b748-82ff627fddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.255924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6a59-09b8-4802-b748-82ff627fddd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.256594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6a59-09b8-4802-b748-82ff627fddd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.258707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6a59-09b8-4802-b748-82ff627fddd8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.263553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b83e-47d0-460d-9bbb-7465d368989b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.268869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.273221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.273221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.273221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.273221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.273221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.360061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 771/1519] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:49.361914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa771e-51d1-4990-85b2-c4fff42b4ce8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.362297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa771e-51d1-4990-85b2-c4fff42b4ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.362632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa771e-51d1-4990-85b2-c4fff42b4ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.394593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 749/1520] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:49.397861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.399375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79aa771e-51d1-4990-85b2-c4fff42b4ce8 None None] MFA Rules not processed for user `efba8929340f441196d06d62814403c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:49.404835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79aa771e-51d1-4990-85b2-c4fff42b4ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:49.490961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 772/1521] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:49.492095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa771e-51d1-4990-85b2-c4fff42b4ce8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.498530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a273f1a-d76e-4205-87c6-2c8e833d86ad admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.507855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.507855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.507855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.507855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.508484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa771e-51d1-4990-85b2-c4fff42b4ce8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.508591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.510825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.515443 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.516411 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.516880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.517448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.518246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.522818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.696089 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 773/1522] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:49.697462 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 750/1523] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:49.698640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.701314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.714652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963183fa-9f07-43b2-b162-aff85077f7ca admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.719477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4566da5-0bd9-4145-9fcd-f392d779697f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.720754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.721521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.722150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.722581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.723636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.726466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.728098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.728098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.728098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.728098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.729898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.731939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.756422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 774/1524] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:49.759245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.768390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfc6fa-ea04-417c-82ef-b7cd509be5b9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.773546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.774147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.774422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.774688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.775395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.778393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.792609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 775/1525] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:49.792609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.803401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7863-d75b-442d-a1f5-653f270e1eb1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.809187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:49.809937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:49.810305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:49.810660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] PATH_INFO: `/v3/projects/1976f40144264d64b7bffdc8c1ebda1c/users/1a804000337942ecb6be472ce22ee43d/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:49.832022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1976f40144264d64b7bffdc8c1ebda1c, user_id=1a804000337942ecb6be472ce22ee43d, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:49.839091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:49.850090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 751/1526] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:49.850090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.920845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 776/1527] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:49 2022] PUT /identity/v3/projects/1976f40144264d64b7bffdc8c1ebda1c/users/1a804000337942ecb6be472ce22ee43d/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:49.921564 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:49.962152 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6cd38-51f3-4bca-9edc-7f71970973e2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:49.998109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98702cac-df34-44a5-a49d-c8b5bee7e9d6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.003827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.004056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.004339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.004717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.005498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.007580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.046601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.047228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.047506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.047776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] PATH_INFO: `/v3/projects/86a22f408379404883b9d53fe987e1b3/users/5863277b18554495ba43b678a4d72fa3/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.063928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a22f408379404883b9d53fe987e1b3, user_id=5863277b18554495ba43b678a4d72fa3, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.066750 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.125900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 777/1528] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:49 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:50.127234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.160790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a7cbf-5920-4be3-b8d9-16ae0fee1e61 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.171482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.176519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.176519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.176519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.176519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.176519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.181794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 752/1529] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:49 2022] PUT /identity/v3/projects/86a22f408379404883b9d53fe987e1b3/users/5863277b18554495ba43b678a4d72fa3/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:50.181794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.198841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 778/1530] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:50.199826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.213122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76751d-97de-4e1b-9fef-d179011a79f6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.279121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b590e5-0b99-4618-a7e9-498dc647e320 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.282232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:50.284998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.285765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.286272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.292960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.292960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.292960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.298527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.299080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.299409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.299679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.300764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.302711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.310467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 753/1531] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:50.311571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.319153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 779/1532] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:50.319153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.329624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e276e-902c-465c-b50c-faeeb5ffd806 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.336918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253b121-e225-4375-82da-abd248e80eac admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.337800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.341194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.341780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.342213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] PATH_INFO: `/v3/projects/eb6c2fbe1055457782409af1efd703b1/users/a917e21481624e149ecf165d4828a7e9/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.347880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.348592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.348869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.349675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] PATH_INFO: `/v3/projects/1976f40144264d64b7bffdc8c1ebda1c/users/1a804000337942ecb6be472ce22ee43d/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.353816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1976f40144264d64b7bffdc8c1ebda1c, user_id=1a804000337942ecb6be472ce22ee43d, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.357789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.368235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6c2fbe1055457782409af1efd703b1, user_id=a917e21481624e149ecf165d4828a7e9, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.371782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 754/1533] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:50 2022] PUT /identity/v3/projects/1976f40144264d64b7bffdc8c1ebda1c/users/1a804000337942ecb6be472ce22ee43d/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:50.381733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.382233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.476201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969ecad-f028-4d51-81f0-b1fd28843114 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.481567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7608593-6ed1-404a-aad9-52850e68d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.482359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7608593-6ed1-404a-aad9-52850e68d785 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.482642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7608593-6ed1-404a-aad9-52850e68d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.482914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7608593-6ed1-404a-aad9-52850e68d785 admin admin] PATH_INFO: `/v3/projects/86a22f408379404883b9d53fe987e1b3/users/5863277b18554495ba43b678a4d72fa3/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.484869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7608593-6ed1-404a-aad9-52850e68d785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a22f408379404883b9d53fe987e1b3, user_id=5863277b18554495ba43b678a4d72fa3, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.487514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7608593-6ed1-404a-aad9-52850e68d785 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.498569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 755/1534] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:50 2022] PUT /identity/v3/projects/86a22f408379404883b9d53fe987e1b3/users/5863277b18554495ba43b678a4d72fa3/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:50.501217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 780/1535] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:50 2022] PUT /identity/v3/projects/eb6c2fbe1055457782409af1efd703b1/users/a917e21481624e149ecf165d4828a7e9/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:50.501328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a67ac-6851-4ae7-951f-a471d8105601 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.501328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a67ac-6851-4ae7-951f-a471d8105601 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.501328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a67ac-6851-4ae7-951f-a471d8105601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.508140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.547804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c98a67ac-6851-4ae7-951f-a471d8105601 None None] MFA Rules not processed for user `1a804000337942ecb6be472ce22ee43d`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:50.549525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c98a67ac-6851-4ae7-951f-a471d8105601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.585426 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3c8b0-d3f2-4587-ad54-b7030081eb1f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.593575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46168f0-38ba-4824-b5da-419ed5f15643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.594487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46168f0-38ba-4824-b5da-419ed5f15643 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.594767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46168f0-38ba-4824-b5da-419ed5f15643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.595087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46168f0-38ba-4824-b5da-419ed5f15643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.595736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46168f0-38ba-4824-b5da-419ed5f15643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.597375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46168f0-38ba-4824-b5da-419ed5f15643 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.616600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 781/1536] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:50.621790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577bc3c-2c7a-453e-8855-dff3a227194a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.621790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577bc3c-2c7a-453e-8855-dff3a227194a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.621790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577bc3c-2c7a-453e-8855-dff3a227194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.668191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 756/1537] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:50.669605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a67ac-6851-4ae7-951f-a471d8105601 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.691871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a67ac-6851-4ae7-951f-a471d8105601 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.700524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.701559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.702017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.702382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] PATH_INFO: `/v3/projects/eb6c2fbe1055457782409af1efd703b1/users/a917e21481624e149ecf165d4828a7e9/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.706171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6c2fbe1055457782409af1efd703b1, user_id=a917e21481624e149ecf165d4828a7e9, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.709844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.728058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 757/1538] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:50 2022] PUT /identity/v3/projects/eb6c2fbe1055457782409af1efd703b1/users/a917e21481624e149ecf165d4828a7e9/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:50.729309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:50.731506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.808318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15222775-8be4-43b4-86de-564c953635e8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:50.812920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47178d-487c-4e47-b8d5-89f990990d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:50.813660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47178d-487c-4e47-b8d5-89f990990d15 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.814319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47178d-487c-4e47-b8d5-89f990990d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.814711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47178d-487c-4e47-b8d5-89f990990d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.829875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8577bc3c-2c7a-453e-8855-dff3a227194a None None] MFA Rules not processed for user `5863277b18554495ba43b678a4d72fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:50.831263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8577bc3c-2c7a-453e-8855-dff3a227194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.897911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47178d-487c-4e47-b8d5-89f990990d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:50.899577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47178d-487c-4e47-b8d5-89f990990d15 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:50.914256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 758/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:50.917289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.917692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.918168 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.942503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 782/1540] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:50.945897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ba1a5-3a94-4dab-98ef-0911f1c838d8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.947929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ba1a5-3a94-4dab-98ef-0911f1c838d8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.948279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ba1a5-3a94-4dab-98ef-0911f1c838d8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:50.952556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 783/1541] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:41:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:50.957648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] MFA Rules not processed for user `a917e21481624e149ecf165d4828a7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:50.958126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:50.983008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:50.983292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:50.983565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.015555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:51.016976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.051299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 759/1542] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:51.083954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.085705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.094894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 784/1543] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:41:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:51.101745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767371e-55df-4300-98ef-ad481dbaf3ca None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.103012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.104135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.104135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.104311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.109229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.110336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:51.114383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.116766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.127528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 760/1544] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:51.134530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed348779-7dcd-4896-b542-cceffd230aa7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.140122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.140765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.141047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.141314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.150523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.152087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.163143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 785/1545] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:51.316344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.325184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6fbe-aa55-4099-b7b1-178cd05da17d service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.328860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.329456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.329734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.330006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.386810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.388314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.398057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 761/1546] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:51.650864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:51.693378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:51.702768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deadc5-98ae-4073-9078-2ae3bbdc3d1e service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:51.707070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911991e-93ce-432d-a509-e8f3c9c1ffa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:51.707070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911991e-93ce-432d-a509-e8f3c9c1ffa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:51.707637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911991e-93ce-432d-a509-e8f3c9c1ffa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:51.707977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911991e-93ce-432d-a509-e8f3c9c1ffa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:51.769021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911991e-93ce-432d-a509-e8f3c9c1ffa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:51.770611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911991e-93ce-432d-a509-e8f3c9c1ffa7 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:51.784603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 786/1547] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:52.327539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:53.393257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:55.004942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:55.062020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:55.157305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613d04a-8cc5-4df9-b46e-3480da8f9611 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:55.165017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:55.165663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:55.166035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:55.166282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] PATH_INFO: `/v3/users/6820fc8ca3994f5d860631f6cbbeb4d3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:55.169680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6820fc8ca3994f5d860631f6cbbeb4d3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:55.173625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:55.422543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6820fc8ca3994f5d860631f6cbbeb4d3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:55.423771 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6820fc8ca3994f5d860631f6cbbeb4d3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:55.452708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6820fc8ca3994f5d860631f6cbbeb4d3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:55.463247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6820fc8ca3994f5d860631f6cbbeb4d3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:55.542596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6820fc8ca3994f5d860631f6cbbeb4d3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:55.580752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:55.581119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:55.581421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:55.588542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 762/1548] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:55 2022] DELETE /identity/v3/users/6820fc8ca3994f5d860631f6cbbeb4d3 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:55.641270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:55.642770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:55.759001 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 787/1549] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:55.774455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:55.775487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:55.798176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:55.800466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:55.822709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc94942-4ea3-452c-a7cc-c8ecb73eb627 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:55.833520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:55.834341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:55.835980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:55.836376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] PATH_INFO: `/v3/users/0ad50e9c18e24cc39a895981476bc9b1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:55.838334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad50e9c18e24cc39a895981476bc9b1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:55.840842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:55.891288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79700f4-7e90-442f-8664-f53feeb22bec admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:55.895754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e62f5-2385-43af-a865-f9d774fbb91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:55.896381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e62f5-2385-43af-a865-f9d774fbb91b service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:55.896640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e62f5-2385-43af-a865-f9d774fbb91b service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:55.896908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e62f5-2385-43af-a865-f9d774fbb91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:55.909432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e62f5-2385-43af-a865-f9d774fbb91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:55.916231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e62f5-2385-43af-a865-f9d774fbb91b service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:55.939884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 763/1550] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:56.008703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:56.086194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad50e9c18e24cc39a895981476bc9b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:56.102342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad50e9c18e24cc39a895981476bc9b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:56.103602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad50e9c18e24cc39a895981476bc9b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:56.104382 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad50e9c18e24cc39a895981476bc9b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:56.187327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad50e9c18e24cc39a895981476bc9b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:56.213565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 788/1551] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:55 2022] DELETE /identity/v3/users/0ad50e9c18e24cc39a895981476bc9b1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:56.215172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:56.215628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:56.215703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:56.236541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:56.237804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:56.329497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 764/1552] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:56.349533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:56.352540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:56.437029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215b23a-e281-4f9c-aef4-6a8c5c1c8cef admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:56.441174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:56.441540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:56.442018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:56.442170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:56.453895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:56.456400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:56.477042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 789/1553] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:41:56.541924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:56.906780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:56.907787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:56.930214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4440-b874-499a-bd23-6243174eda0a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:56.938603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:56.939311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:56.939657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:56.945901 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] PATH_INFO: `/v3/projects/53f03fa2ae254b2fb0f567cd6ae18465` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:56.948517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f03fa2ae254b2fb0f567cd6ae18465)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:56.950972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:57.162586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f03fa2ae254b2fb0f567cd6ae18465', 'request_id': 'req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.169043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f03fa2ae254b2fb0f567cd6ae18465', 'request_id': 'req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.174652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f03fa2ae254b2fb0f567cd6ae18465', 'request_id': 'req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.206288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:57.207811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:57.229099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24086712-4885-4f98-92d8-a83bd0e1841c service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:57.289123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:57.289779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:57.290056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:57.290327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] PATH_INFO: `/v3/projects/e9d17fa53de24ef9aa143d4f6713e209` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:57.291448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d17fa53de24ef9aa143d4f6713e209)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:57.293398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:57.309655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] The token cache is being invalidate because project 53f03fa2ae254b2fb0f567cd6ae18465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:57.310207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.310702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.312371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 765/1554] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:56 2022] DELETE /identity/v3/projects/53f03fa2ae254b2fb0f567cd6ae18465 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:57.316376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:57.318007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:57.331345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e615d-38a3-46d9-8b0b-da9e27a9fc02 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:57.336721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:57.337345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:57.337623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:57.338022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] PATH_INFO: `/v3/users/1a804000337942ecb6be472ce22ee43d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:57.339169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a804000337942ecb6be472ce22ee43d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:57.341138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:57.459563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d17fa53de24ef9aa143d4f6713e209', 'request_id': 'req-a1ae332c-e518-4e85-a90c-6bd6a522596c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.464975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d17fa53de24ef9aa143d4f6713e209', 'request_id': 'req-a1ae332c-e518-4e85-a90c-6bd6a522596c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.471223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d17fa53de24ef9aa143d4f6713e209', 'request_id': 'req-a1ae332c-e518-4e85-a90c-6bd6a522596c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.612531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] The token cache is being invalidate because project e9d17fa53de24ef9aa143d4f6713e209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:57.612826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.613675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1ae332c-e518-4e85-a90c-6bd6a522596c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.615052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 790/1555] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:57 2022] DELETE /identity/v3/projects/e9d17fa53de24ef9aa143d4f6713e209 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:57.616565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7642c-619b-49bf-b364-d0db93497f69 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:57.616863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7642c-619b-49bf-b364-d0db93497f69 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:57.617175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7642c-619b-49bf-b364-d0db93497f69 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:57.618518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 791/1556] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:41:57.619220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7642c-619b-49bf-b364-d0db93497f69 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:57.620895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ba7642c-619b-49bf-b364-d0db93497f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:57.720639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a804000337942ecb6be472ce22ee43d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.721726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a804000337942ecb6be472ce22ee43d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.736153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a804000337942ecb6be472ce22ee43d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.742933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7642c-619b-49bf-b364-d0db93497f69 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:57.744015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a804000337942ecb6be472ce22ee43d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.750243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:57.751034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:57.751452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:57.751773 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] PATH_INFO: `/v3/users/cb33224910a34fdcbf8862c6294d5965` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:57.753486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb33224910a34fdcbf8862c6294d5965)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:57.757453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:57.817046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:57.874320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-12eaac6c-1450-4d92-ba51-efd7e8cc8e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a804000337942ecb6be472ce22ee43d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:57.876726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 766/1557] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:57 2022] DELETE /identity/v3/users/1a804000337942ecb6be472ce22ee43d => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:57.877982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:57.878271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:57.878546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:57.901739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:57.903143 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:57.987168 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 767/1558] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:41:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:58.066591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb33224910a34fdcbf8862c6294d5965'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.078012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb33224910a34fdcbf8862c6294d5965'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.078729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb33224910a34fdcbf8862c6294d5965'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.079641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb33224910a34fdcbf8862c6294d5965'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.095224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:58.096665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:58.109971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4414bf-3a7a-4ab7-8742-d98fa8066178 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:58.117268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:58.118130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:58.119836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:58.119836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:58.120952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:58.134656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:58.136354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:58.160773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 768/1559] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:41:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:41:58.176332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb33224910a34fdcbf8862c6294d5965'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.199690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 792/1560] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:41:57 2022] DELETE /identity/v3/users/cb33224910a34fdcbf8862c6294d5965 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:58.584358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:58.585982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:58.667232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0520e3b-3f64-410f-bf6c-89eea5105157 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:58.735821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:58.736476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:58.736764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:58.737033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] PATH_INFO: `/v3/projects/1976f40144264d64b7bffdc8c1ebda1c` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:58.738148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1976f40144264d64b7bffdc8c1ebda1c)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:58.740084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:58.841747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:58.877554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:58.879129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:58.897166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373677c0-f912-40b2-9303-cafd7ee27fb6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:58.900332 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1976f40144264d64b7bffdc8c1ebda1c', 'request_id': 'req-29abbe64-e7a6-43d6-9e67-349b0dd398f1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.918308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1976f40144264d64b7bffdc8c1ebda1c', 'request_id': 'req-29abbe64-e7a6-43d6-9e67-349b0dd398f1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.924107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1976f40144264d64b7bffdc8c1ebda1c', 'request_id': 'req-29abbe64-e7a6-43d6-9e67-349b0dd398f1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:58.968326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:58.969079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:58.969365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:58.969633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] PATH_INFO: `/v3/projects/971411ae8a674a258088d624ad0af700` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:58.970760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] RBAC: Authorizing `identity:delete_project(project_id=971411ae8a674a258088d624ad0af700)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:58.972798 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.095891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] The token cache is being invalidate because project 1976f40144264d64b7bffdc8c1ebda1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:59.096177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.099552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-29abbe64-e7a6-43d6-9e67-349b0dd398f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.099552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 769/1561] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:58 2022] DELETE /identity/v3/projects/1976f40144264d64b7bffdc8c1ebda1c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:41:59.104022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8015-7a6e-4553-b1c1-eb3c4107d902 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.104308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8015-7a6e-4553-b1c1-eb3c4107d902 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.104629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8015-7a6e-4553-b1c1-eb3c4107d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.138812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e3dc8015-7a6e-4553-b1c1-eb3c4107d902 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:59.140058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e3dc8015-7a6e-4553-b1c1-eb3c4107d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:59.145036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971411ae8a674a258088d624ad0af700', 'request_id': 'req-db620226-37e8-4e0c-aefd-d618525c895e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.152549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971411ae8a674a258088d624ad0af700', 'request_id': 'req-db620226-37e8-4e0c-aefd-d618525c895e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.160740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971411ae8a674a258088d624ad0af700', 'request_id': 'req-db620226-37e8-4e0c-aefd-d618525c895e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.227736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 770/1562] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:41:59.230105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd068de-aa36-4703-8321-664b0fd09dff None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.230397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd068de-aa36-4703-8321-664b0fd09dff None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.230669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd068de-aa36-4703-8321-664b0fd09dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.252650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0bd068de-aa36-4703-8321-664b0fd09dff None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:59.253995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0bd068de-aa36-4703-8321-664b0fd09dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:59.262647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 771/1563] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:59.266857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd068de-aa36-4703-8321-664b0fd09dff None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.276948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd068de-aa36-4703-8321-664b0fd09dff None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.280300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] The token cache is being invalidate because project 971411ae8a674a258088d624ad0af700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:41:59.281080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.283372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.283691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.283984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.284315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.285216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:59.285499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.287221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.292002 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-db620226-37e8-4e0c-aefd-d618525c895e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:41:59.294122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 793/1564] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:41:58 2022] DELETE /identity/v3/projects/971411ae8a674a258088d624ad0af700 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:41:59.299519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d63ed-a782-483a-a67c-96ffbf0a2116 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.299951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d63ed-a782-483a-a67c-96ffbf0a2116 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.300235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d63ed-a782-483a-a67c-96ffbf0a2116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.303813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 772/1565] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:41:59.308870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.312907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:59.324983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1d0d63ed-a782-483a-a67c-96ffbf0a2116 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:59.326194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1d0d63ed-a782-483a-a67c-96ffbf0a2116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:59.339403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04476d1d-b3cb-4db2-b47d-3b643b48b5c1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.344277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 794/1566] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:59.345870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2aff-e730-42c3-814e-3d562343c69c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.346326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2aff-e730-42c3-814e-3d562343c69c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.346622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2aff-e730-42c3-814e-3d562343c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.352918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.357031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.357031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.357031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.357485 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.361932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.371594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-de4c2aff-e730-42c3-814e-3d562343c69c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:41:59.387488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-de4c2aff-e730-42c3-814e-3d562343c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:41:59.408038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 795/1567] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:41:59.410119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c2aff-e730-42c3-814e-3d562343c69c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.424246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c2aff-e730-42c3-814e-3d562343c69c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.432496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.433118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.433393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.433663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.434384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:41:59.434597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.436235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.449676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 796/1568] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:41:59.456260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.466776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df811d-1f42-4f45-a481-6787b4dff9c5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.471639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.472393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.472699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.473058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.473709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.475697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.510157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:59.542079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 773/1569] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:59.545222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.600828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 797/1570] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:59.605264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.609998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14a0fd-254f-4ff5-8899-229ea6aafc9b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.626111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:41:59.667955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e93b0-49fb-4190-9a53-0a23f166119e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.669698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.670323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.670595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.670861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.671484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.672655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.673256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.673494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.673668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.673825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.674408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.676337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.830054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 798/1571] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:41:59.831679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 774/1572] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:41:59 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:41:59.834252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.835860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.844853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e303c-3a9b-4f69-a3dc-67bdacebdba2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.849205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c885-57f6-4352-aea5-efe4966e100b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.851345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.851942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.852218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.852509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.853275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.854861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.855072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.865141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.865141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.865141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.865141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.865141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.866056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 799/1573] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:59.869706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.875735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 775/1574] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:59.877122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.879986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1204ea2-99d4-463c-bd2f-9ed7384ba30e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.884865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.885456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.885730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.886061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.886729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.887937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a205f-5234-493f-a2fc-6c6cafa70c41 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.888358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.893444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.894522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.894522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.894811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.895253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.896946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.904557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 800/1575] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:41:59.909013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.921803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 776/1576] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:41:59.924122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737c4e7-85be-454f-9faf-586b79bc58d1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.927415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:41:59.933894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.934693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.934972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.935248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] PATH_INFO: `/v3/projects/53ebfad7d6dc4b8a97295598570fd3b9/users/bc0645aa96ea4e728c9a1e8c29f28a06/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.940290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d54a-1471-4651-b858-b52db4b2c1fb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:41:59.953066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ebfad7d6dc4b8a97295598570fd3b9, user_id=bc0645aa96ea4e728c9a1e8c29f28a06, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.953270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36200278-8e51-46d4-97b2-f9c19bff36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:41:59.953814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36200278-8e51-46d4-97b2-f9c19bff36b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:41:59.954098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36200278-8e51-46d4-97b2-f9c19bff36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:41:59.954371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36200278-8e51-46d4-97b2-f9c19bff36b2 admin admin] PATH_INFO: `/v3/projects/ce9c4b3860a34a54a0e2f41f239973dd/users/d31f07ba20b94eb298bc60ab95900cb9/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:41:59.957163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:41:59.975438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36200278-8e51-46d4-97b2-f9c19bff36b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c4b3860a34a54a0e2f41f239973dd, user_id=d31f07ba20b94eb298bc60ab95900cb9, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:41:59.978422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36200278-8e51-46d4-97b2-f9c19bff36b2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.095090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 801/1577] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:59 2022] PUT /identity/v3/projects/53ebfad7d6dc4b8a97295598570fd3b9/users/bc0645aa96ea4e728c9a1e8c29f28a06/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:00.096304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.099758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 777/1578] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:41:59 2022] PUT /identity/v3/projects/ce9c4b3860a34a54a0e2f41f239973dd/users/d31f07ba20b94eb298bc60ab95900cb9/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:00.105061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:00.107985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819db99-192f-4f80-92e0-ad5a050599db None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.108283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819db99-192f-4f80-92e0-ad5a050599db None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.108589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819db99-192f-4f80-92e0-ad5a050599db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.149898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1819db99-192f-4f80-92e0-ad5a050599db None None] MFA Rules not processed for user `bc0645aa96ea4e728c9a1e8c29f28a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:00.151741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1819db99-192f-4f80-92e0-ad5a050599db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:00.181772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd903d31-1cbf-4f5a-861e-90672333c0aa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.229313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 778/1579] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:00.230790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef771d-dc2a-4234-a5a3-4a60a5e42754 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.231147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef771d-dc2a-4234-a5a3-4a60a5e42754 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.231804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef771d-dc2a-4234-a5a3-4a60a5e42754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.260673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.260673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.260673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.260673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.262484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:00.267126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2bef771d-dc2a-4234-a5a3-4a60a5e42754 None None] MFA Rules not processed for user `d31f07ba20b94eb298bc60ab95900cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:00.268400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2bef771d-dc2a-4234-a5a3-4a60a5e42754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:00.336922 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 779/1580] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:00.337828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef771d-dc2a-4234-a5a3-4a60a5e42754 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.340767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.342217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.352318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 802/1581] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:00.353152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.402891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef771d-dc2a-4234-a5a3-4a60a5e42754 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.410476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.411758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.412036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.412311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.412960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.415004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.426503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2238-c39a-4b86-a46f-a7ef10abb198 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.440147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.440823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.441102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.441376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.442018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.445054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.520577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 780/1582] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:00 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:00.522018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.541614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 803/1583] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:00 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:00.544466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.629576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8c72d-94ca-47da-a1be-d2acc33900aa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.635062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.635695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.635985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.636389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.636998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.638989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.645651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fc790-10fc-486d-b678-549e57e68036 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.650365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.650978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.651259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.651532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.652172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.654215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.765567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 781/1584] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:00 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:00.769013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 804/1585] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:00 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:00.769013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.769183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.777060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0dc5-25a4-46e2-8a5f-d9a6fc28369c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.777825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628fa39-a295-48dc-aa9a-03c49c1d0756 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.782777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.783389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.783670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.783771 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.784079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.784609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.784792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.785192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.785825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.787044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.787147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.788809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.800419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 782/1586] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:00.804077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 805/1587] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:00.805013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.805772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.820162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b38d2d-ca0d-4e7f-84d4-2e24310a7941 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.821983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d42ec-0798-4c46-91d3-7b8620ba4148 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.827203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.827976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.828714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.828952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] PATH_INFO: `/v3/projects/42c037069ee748b5bd6b1d76d4a5de81/users/fd237df940f24d609b624e3ab6f5a81b/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.832358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.833604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.833887 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.834158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.835888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.837906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.849509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c037069ee748b5bd6b1d76d4a5de81, user_id=fd237df940f24d609b624e3ab6f5a81b, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.850885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 783/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:00.852275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.854827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.865434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d50b5e-012b-4587-8571-42e782de5cd1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:00.870186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee3442-a403-41f6-b47e-eb8bb9d73ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:00.870827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3442-a403-41f6-b47e-eb8bb9d73ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.871102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3442-a403-41f6-b47e-eb8bb9d73ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.871369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee3442-a403-41f6-b47e-eb8bb9d73ca3 admin admin] PATH_INFO: `/v3/projects/5141a1986a044b2b900ae7df592f4653/users/de4b7de8b4ac46e88f252040f37d4533/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:00.886226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee3442-a403-41f6-b47e-eb8bb9d73ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5141a1986a044b2b900ae7df592f4653, user_id=de4b7de8b4ac46e88f252040f37d4533, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:00.888900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee3442-a403-41f6-b47e-eb8bb9d73ca3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:00.980602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 806/1589] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:00 2022] PUT /identity/v3/projects/42c037069ee748b5bd6b1d76d4a5de81/users/fd237df940f24d609b624e3ab6f5a81b/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:00.981347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 784/1590] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:00 2022] PUT /identity/v3/projects/5141a1986a044b2b900ae7df592f4653/users/de4b7de8b4ac46e88f252040f37d4533/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:00.984380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:00.991182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ae6d-eaee-4c8d-bba3-86a45f3cdbd8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:00.991467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ae6d-eaee-4c8d-bba3-86a45f3cdbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:00.991777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ae6d-eaee-4c8d-bba3-86a45f3cdbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.018714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4070ae6d-eaee-4c8d-bba3-86a45f3cdbd8 None None] MFA Rules not processed for user `de4b7de8b4ac46e88f252040f37d4533`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:01.019922 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4070ae6d-eaee-4c8d-bba3-86a45f3cdbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:01.046007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f76784-aa5b-450d-bbee-1028cbe433a2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.063234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:01.085720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 785/1591] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:01.093459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ae6d-eaee-4c8d-bba3-86a45f3cdbd8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.114945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.116546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.116546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.116546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.116800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.119728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.140884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 807/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:01.145328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.159059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9582ccb-1f71-4188-ba55-6e18d0c7560f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.166892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d94d5-3c8e-4ad5-8910-71b872fbcec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.167634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d94d5-3c8e-4ad5-8910-71b872fbcec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.167979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d94d5-3c8e-4ad5-8910-71b872fbcec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.168308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d94d5-3c8e-4ad5-8910-71b872fbcec8 admin admin] PATH_INFO: `/v3/projects/42c037069ee748b5bd6b1d76d4a5de81/users/fd237df940f24d609b624e3ab6f5a81b/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.170580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d94d5-3c8e-4ad5-8910-71b872fbcec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c037069ee748b5bd6b1d76d4a5de81, user_id=fd237df940f24d609b624e3ab6f5a81b, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.175471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d94d5-3c8e-4ad5-8910-71b872fbcec8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.181988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ae6d-eaee-4c8d-bba3-86a45f3cdbd8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.189003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 808/1593] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:01 2022] PUT /identity/v3/projects/42c037069ee748b5bd6b1d76d4a5de81/users/fd237df940f24d609b624e3ab6f5a81b/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:01.200175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bff3e-36f8-4592-ad78-5af4346df701 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.200670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bff3e-36f8-4592-ad78-5af4346df701 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.201649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bff3e-36f8-4592-ad78-5af4346df701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.248463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-400bff3e-36f8-4592-ad78-5af4346df701 None None] MFA Rules not processed for user `fd237df940f24d609b624e3ab6f5a81b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:01.249771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-400bff3e-36f8-4592-ad78-5af4346df701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:01.255394 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.256017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.256297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.256602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.259785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.259785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.346504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 809/1594] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:01.360919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bff3e-36f8-4592-ad78-5af4346df701 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.393058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 786/1595] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:01 2022] POST /identity/v3/projects => generated 375 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:01.394527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.443552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bff3e-36f8-4592-ad78-5af4346df701 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.478237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c28e9b-5f34-428c-8176-b96df2e6dbf7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.483250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.483798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.484075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.484345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.485008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.486942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.500216 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.500862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.501139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.501412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.572198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.573691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.584131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 810/1596] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:01.613848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.614321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 787/1597] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:01 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:01.617194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.625138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124bac1-6b52-4a39-81bb-f7d2427645ff service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.627099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8391d-8469-4d0b-899a-e309c9c8e7a5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.630526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.631235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.631416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.631681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] PATH_INFO: `/v3/users/bc0645aa96ea4e728c9a1e8c29f28a06` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.632646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.632820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0645aa96ea4e728c9a1e8c29f28a06)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.633249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.633414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.633675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.634583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.634820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.636384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.647994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 788/1598] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:01.652155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.664658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab755a2-3cab-45ed-8fa4-3da896a3ff58 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.670917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.671584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.673421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.673421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] PATH_INFO: `/v3/projects/60893b857b704559a442d1f5948a3eaa/users/e5329aef72544602ac79439edb287d19/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.701385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60893b857b704559a442d1f5948a3eaa, user_id=e5329aef72544602ac79439edb287d19, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.705170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.791069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 789/1599] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:01 2022] PUT /identity/v3/projects/60893b857b704559a442d1f5948a3eaa/users/e5329aef72544602ac79439edb287d19/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:01.795226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.875878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700677fd-a05b-415c-84f5-3a96d7f7f8e3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.881864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.882580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.882916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.883250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.883955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.885635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.890347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:01.896198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 790/1600] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:01.900654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:01.910350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0645aa96ea4e728c9a1e8c29f28a06'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.925444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19387ce2-d312-4e8f-b62b-14abe6d9471b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:01.925560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0645aa96ea4e728c9a1e8c29f28a06'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.925560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0645aa96ea4e728c9a1e8c29f28a06'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.925560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0645aa96ea4e728c9a1e8c29f28a06'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:01.926442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ae163-ed20-4086-917b-b6ac01d786c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:01.927632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ae163-ed20-4086-917b-b6ac01d786c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.927910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ae163-ed20-4086-917b-b6ac01d786c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.928182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ae163-ed20-4086-917b-b6ac01d786c6 admin admin] PATH_INFO: `/v3/projects/60893b857b704559a442d1f5948a3eaa/users/e5329aef72544602ac79439edb287d19/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.930278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ae163-ed20-4086-917b-b6ac01d786c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60893b857b704559a442d1f5948a3eaa, user_id=e5329aef72544602ac79439edb287d19, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:01.933057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ae163-ed20-4086-917b-b6ac01d786c6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:01.944681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 791/1601] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:01 2022] PUT /identity/v3/projects/60893b857b704559a442d1f5948a3eaa/users/e5329aef72544602ac79439edb287d19/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:01.956102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:01.956412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:01.956731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:01.993861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] MFA Rules not processed for user `e5329aef72544602ac79439edb287d19`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:01.994934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.031325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e8fd8c53-e57c-4bca-a85e-7074dc0bdfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0645aa96ea4e728c9a1e8c29f28a06'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.058053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 811/1602] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:01 2022] DELETE /identity/v3/users/bc0645aa96ea4e728c9a1e8c29f28a06 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:02.060092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.060380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.060706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.068649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 792/1603] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:02.083918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:02.085418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.086095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:02.087602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.155987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70720-387f-4992-a880-26d7a929d8a2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:02.168144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 812/1604] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:02.181891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:02.183287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.211501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:02.212157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.212461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.212759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.214719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.244414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687a19f-8c42-4599-8bfc-2e182146aee0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:02.248221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:02.248924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.250809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.251175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.260790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:02.262318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:02.274045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 813/1605] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:02.284297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:02.286441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:02.296633 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 793/1606] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:02.814382 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:02.815827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:02.837258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f14f6-cf4f-44d3-85cf-1224fb044dc4 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:02.850511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:02.851151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:02.851428 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:02.851694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] PATH_INFO: `/v3/projects/53ebfad7d6dc4b8a97295598570fd3b9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:02.852959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ebfad7d6dc4b8a97295598570fd3b9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:02.854872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:02.963319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ebfad7d6dc4b8a97295598570fd3b9', 'request_id': 'req-d16a878f-817d-49d0-a9d1-2c767db6964f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.972564 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ebfad7d6dc4b8a97295598570fd3b9', 'request_id': 'req-d16a878f-817d-49d0-a9d1-2c767db6964f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:02.979992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ebfad7d6dc4b8a97295598570fd3b9', 'request_id': 'req-d16a878f-817d-49d0-a9d1-2c767db6964f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.075052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] The token cache is being invalidate because project 53ebfad7d6dc4b8a97295598570fd3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:03.075453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.076037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.077545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 814/1607] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:02 2022] DELETE /identity/v3/projects/53ebfad7d6dc4b8a97295598570fd3b9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:03.081674 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:03.094786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401de31c-edf0-4e30-b447-7aac80024d7c service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:03.153395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:03.154033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:03.159313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:03.159313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] PATH_INFO: `/v3/users/fd237df940f24d609b624e3ab6f5a81b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:03.159313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd237df940f24d609b624e3ab6f5a81b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:03.159313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:03.441350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd237df940f24d609b624e3ab6f5a81b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.442019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd237df940f24d609b624e3ab6f5a81b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.455171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd237df940f24d609b624e3ab6f5a81b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.462780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd237df940f24d609b624e3ab6f5a81b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.544688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f3182d6-34e8-413f-ab60-56da7df81bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd237df940f24d609b624e3ab6f5a81b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:03.554877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 794/1608] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:03 2022] DELETE /identity/v3/users/fd237df940f24d609b624e3ab6f5a81b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:03.790734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:04.198728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.200225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:04.213313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a878f-817d-49d0-a9d1-2c767db6964f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.278051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.278051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.278051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.278051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] PATH_INFO: `/v3/projects/42c037069ee748b5bd6b1d76d4a5de81` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.278383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c037069ee748b5bd6b1d76d4a5de81)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.279389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.401885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c037069ee748b5bd6b1d76d4a5de81', 'request_id': 'req-2e178a30-c44d-41cd-b7e6-d7bacffa3778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.407951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c037069ee748b5bd6b1d76d4a5de81', 'request_id': 'req-2e178a30-c44d-41cd-b7e6-d7bacffa3778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.415215 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c037069ee748b5bd6b1d76d4a5de81', 'request_id': 'req-2e178a30-c44d-41cd-b7e6-d7bacffa3778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.520075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] The token cache is being invalidate because project 42c037069ee748b5bd6b1d76d4a5de81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:04.520400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.521052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2e178a30-c44d-41cd-b7e6-d7bacffa3778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:04.522812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 815/1609] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:04 2022] DELETE /identity/v3/projects/42c037069ee748b5bd6b1d76d4a5de81 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:04.527507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbccd1-8b45-4b28-a28e-1679c6b00aba None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.528017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbccd1-8b45-4b28-a28e-1679c6b00aba None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.528131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbccd1-8b45-4b28-a28e-1679c6b00aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.548757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d5fbccd1-8b45-4b28-a28e-1679c6b00aba None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:04.550343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d5fbccd1-8b45-4b28-a28e-1679c6b00aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:04.610390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 795/1610] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:04.618763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfaadc-c047-40f4-951e-cbd251193d02 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.619051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfaadc-c047-40f4-951e-cbd251193d02 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.619328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfaadc-c047-40f4-951e-cbd251193d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.639384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-babfaadc-c047-40f4-951e-cbd251193d02 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:04.640729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-babfaadc-c047-40f4-951e-cbd251193d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:04.649159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 816/1611] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:04.653660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbccd1-8b45-4b28-a28e-1679c6b00aba None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.664513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbccd1-8b45-4b28-a28e-1679c6b00aba None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.669409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.669842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.670048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.670333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.671067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:04.671373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.672996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.685126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 796/1612] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:04.695039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfaadc-c047-40f4-951e-cbd251193d02 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.704510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfaadc-c047-40f4-951e-cbd251193d02 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.710926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.711532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.711810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.712081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.712760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.714661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.795850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 817/1613] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:04 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:04.800120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:04.810244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31015f36-84bd-4868-98dd-db53eeeb0b75 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:04.871581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:04.872183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:04.874038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:04.882450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:04.882450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:04.882450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:04.882450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:04.992249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 797/1614] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:04 2022] POST /identity/v3/users => generated 305 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:04.996735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.010668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e946-c49b-40d0-bcb8-e21501b8c2a2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.023245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.024018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.024300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.026000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.026882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.028528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.062794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 818/1615] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:05.066974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.089456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1b4d-29ce-453b-81d6-53dd22206855 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.108189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e0220-868b-4dc6-ab5b-d0c90b6c46fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.109718 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e0220-868b-4dc6-ab5b-d0c90b6c46fa admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.110582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e0220-868b-4dc6-ab5b-d0c90b6c46fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.119380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e0220-868b-4dc6-ab5b-d0c90b6c46fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.120319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e0220-868b-4dc6-ab5b-d0c90b6c46fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.126327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e0220-868b-4dc6-ab5b-d0c90b6c46fa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.151669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 798/1616] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:05.155916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.166076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148934f-a4c7-4c9c-854a-aa0ea58563dc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.171069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.181950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.181950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.181950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] PATH_INFO: `/v3/projects/d5d1ad027e2548bca6f07f82abf8709b/users/9ef2c1c50ae74169a2e9dec88382f0e3/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.205071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d1ad027e2548bca6f07f82abf8709b, user_id=9ef2c1c50ae74169a2e9dec88382f0e3, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.208459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.385832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 819/1617] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:05 2022] PUT /identity/v3/projects/d5d1ad027e2548bca6f07f82abf8709b/users/9ef2c1c50ae74169a2e9dec88382f0e3/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:05.401920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.402337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.402616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.445519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] MFA Rules not processed for user `9ef2c1c50ae74169a2e9dec88382f0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:05.447496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.528382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 799/1618] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:05 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:05.530820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.601811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eccb9-fef3-426a-af20-a1076ee98cc0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.604674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.605547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.605831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.606102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.606734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.615099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.651967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.653384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.710304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd2a9d-ae67-4ad1-ad4c-8d82213a0634 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.714896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.715516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.715799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.716083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.717976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:05.733676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 820/1619] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:05 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:05.736250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.786318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.787765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.796757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 800/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:05.803876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee58a9-8cce-4f74-8b94-cf797f5da0a8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.809159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.809621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.809897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.810161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.810782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.812741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.947762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 821/1621] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:05 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:05.951701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:05.966805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e36c9-9b1a-4a9d-8de8-e06380bd74e4 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:05.971679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:05.972308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:05.972678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:05.972963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:05.974126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:05.975726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:05.990195 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 801/1622] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:05.991381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.002552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05a49c-aec2-41c7-bb8b-e31a45ebefdf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.007265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.007960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.008330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.008519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] PATH_INFO: `/v3/projects/aa3345102dea488096fbba31c8a9c2c4/users/11cbbc57a64840faa52d292e2a438581/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.023626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3345102dea488096fbba31c8a9c2c4, user_id=11cbbc57a64840faa52d292e2a438581, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.026323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.130804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 822/1623] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:05 2022] PUT /identity/v3/projects/aa3345102dea488096fbba31c8a9c2c4/users/11cbbc57a64840faa52d292e2a438581/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:06.134774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.144992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18762a-6fce-41b1-8550-ffc77c24bbe1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.206482 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47349e26-058a-4aa6-84fc-d23a89ad93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.208970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47349e26-058a-4aa6-84fc-d23a89ad93fd admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.208970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47349e26-058a-4aa6-84fc-d23a89ad93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.208970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47349e26-058a-4aa6-84fc-d23a89ad93fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.208970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47349e26-058a-4aa6-84fc-d23a89ad93fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.210461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47349e26-058a-4aa6-84fc-d23a89ad93fd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.223916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 802/1624] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:06.225974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.237173 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d2735-a1f3-4d91-932e-885ebd51479c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.241990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.242706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.242949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.243219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] PATH_INFO: `/v3/projects/aa3345102dea488096fbba31c8a9c2c4/users/11cbbc57a64840faa52d292e2a438581/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.245151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3345102dea488096fbba31c8a9c2c4, user_id=11cbbc57a64840faa52d292e2a438581, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.247774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.258370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 823/1625] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:06 2022] PUT /identity/v3/projects/aa3345102dea488096fbba31c8a9c2c4/users/11cbbc57a64840faa52d292e2a438581/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:06.276701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53b97-d56a-4cca-baa5-5981537d5c57 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.277044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53b97-d56a-4cca-baa5-5981537d5c57 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.277322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c53b97-d56a-4cca-baa5-5981537d5c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.310264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a6c53b97-d56a-4cca-baa5-5981537d5c57 None None] MFA Rules not processed for user `11cbbc57a64840faa52d292e2a438581`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:06.311500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a6c53b97-d56a-4cca-baa5-5981537d5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:06.398413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 803/1626] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:06 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:06.409676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.412143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:06.503258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01f606-8403-46e1-9012-6b18a0745075 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.509760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.509760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.509760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.509760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.518363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:06.519945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:06.533261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 824/1627] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:06 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:06.936621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c53b97-d56a-4cca-baa5-5981537d5c57 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:06.946740 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c53b97-d56a-4cca-baa5-5981537d5c57 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:06.950597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:06.951222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:06.951495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:06.951809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:06.983968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:07.010308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:07.011749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:07.020473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 804/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:06 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:07.439037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:07.900091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:07.909063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90559954-3903-4e80-87e4-41aa938ff8c3 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:07.913407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea320100-659d-4346-aa62-768c782bcfda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:07.914024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320100-659d-4346-aa62-768c782bcfda service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:07.914543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320100-659d-4346-aa62-768c782bcfda service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:07.914976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea320100-659d-4346-aa62-768c782bcfda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:07.916963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ea320100-659d-4346-aa62-768c782bcfda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:07.984777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea320100-659d-4346-aa62-768c782bcfda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:07.990245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea320100-659d-4346-aa62-768c782bcfda service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:07.998984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 825/1629] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:08.660260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:08.662298 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:08.738406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbaee06-219c-47b8-90c0-72d7185628fe service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:08.743364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:08.744000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:08.744276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:08.744578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] PATH_INFO: `/v3/users/efba8929340f441196d06d62814403c1` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:08.745703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=efba8929340f441196d06d62814403c1)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:08.747857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:08.996119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efba8929340f441196d06d62814403c1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:08.996873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efba8929340f441196d06d62814403c1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:09.015355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efba8929340f441196d06d62814403c1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:09.026215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efba8929340f441196d06d62814403c1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:09.129979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efba8929340f441196d06d62814403c1'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:09.136589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 805/1630] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:08 2022] DELETE /identity/v3/users/efba8929340f441196d06d62814403c1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:09.149391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:09.150070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:09.150070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:09.170628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:09.171970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:09.202201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:09.244141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 826/1631] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:09.253582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:09.255050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:09.316228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797f34-5899-41c0-8f43-31586195a3bf admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:09.320445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:09.321205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:09.321486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:09.321754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:09.330586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:09.331998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:09.341270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 806/1632] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:09.774399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:09.775398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:09.788338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bd02b-0a88-4e0a-ac82-86c94f4812e5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:09.793039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:09.793671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:09.793948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:09.794217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] PATH_INFO: `/v3/projects/a3373147a7f44462bd4d354d58686b63` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:09.795333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3373147a7f44462bd4d354d58686b63)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:09.803138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:09.938247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3373147a7f44462bd4d354d58686b63', 'request_id': 'req-49b77f85-27a1-4b91-b3c2-e2515130cffe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:09.945232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:09.951354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3373147a7f44462bd4d354d58686b63', 'request_id': 'req-49b77f85-27a1-4b91-b3c2-e2515130cffe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:09.955854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3373147a7f44462bd4d354d58686b63', 'request_id': 'req-49b77f85-27a1-4b91-b3c2-e2515130cffe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.049255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] The token cache is being invalidate because project a3373147a7f44462bd4d354d58686b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:10.049255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.049255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.049255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 827/1633] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:09 2022] DELETE /identity/v3/projects/a3373147a7f44462bd4d354d58686b63 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:10.052642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:10.070901 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81b57-c852-4e7e-b089-7e5399a1bfea service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:10.173685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:10.174461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:10.174741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:10.175010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] PATH_INFO: `/v3/users/a917e21481624e149ecf165d4828a7e9` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:10.192619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a917e21481624e149ecf165d4828a7e9)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:10.192619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:10.534444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a917e21481624e149ecf165d4828a7e9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.535091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a917e21481624e149ecf165d4828a7e9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.548779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a917e21481624e149ecf165d4828a7e9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.556212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a917e21481624e149ecf165d4828a7e9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.627520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-07713e8a-2c7a-43ba-8c5c-9651b2d43032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a917e21481624e149ecf165d4828a7e9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:10.640142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 807/1634] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:10 2022] DELETE /identity/v3/users/a917e21481624e149ecf165d4828a7e9 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:11.530846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:11.532237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:11.545442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b77f85-27a1-4b91-b3c2-e2515130cffe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:11.638813 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:11.640145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:11.640452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:11.640729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] PATH_INFO: `/v3/projects/eb6c2fbe1055457782409af1efd703b1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:11.643197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6c2fbe1055457782409af1efd703b1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:11.645213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:11.726747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:11.768666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6c2fbe1055457782409af1efd703b1', 'request_id': 'req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:11.776646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6c2fbe1055457782409af1efd703b1', 'request_id': 'req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:11.783713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6c2fbe1055457782409af1efd703b1', 'request_id': 'req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:11.843305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] The token cache is being invalidate because project eb6c2fbe1055457782409af1efd703b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:11.843591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:11.844207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-14399f2c-9f1d-44c5-9213-c17ed33d7b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:11.845758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 828/1635] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:11 2022] DELETE /identity/v3/projects/eb6c2fbe1055457782409af1efd703b1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:11.852385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36402ff-ac67-4d56-af25-0d0a8b588bdd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:11.852723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36402ff-ac67-4d56-af25-0d0a8b588bdd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:11.852995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36402ff-ac67-4d56-af25-0d0a8b588bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:11.882066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d36402ff-ac67-4d56-af25-0d0a8b588bdd None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:11.883741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d36402ff-ac67-4d56-af25-0d0a8b588bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:11.958526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 808/1636] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:11.966960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8080e8-5c36-40ea-b72e-09ff61422d41 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:11.967246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8080e8-5c36-40ea-b72e-09ff61422d41 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:11.967515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8080e8-5c36-40ea-b72e-09ff61422d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.023964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ba8080e8-5c36-40ea-b72e-09ff61422d41 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:12.026075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ba8080e8-5c36-40ea-b72e-09ff61422d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:12.035881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 829/1637] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:12.039812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36402ff-ac67-4d56-af25-0d0a8b588bdd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.052857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36402ff-ac67-4d56-af25-0d0a8b588bdd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.058161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.058796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.059077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.059346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.059991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:12.060309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.065160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.084845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 809/1638] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:12.087083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8080e8-5c36-40ea-b72e-09ff61422d41 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.099203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8080e8-5c36-40ea-b72e-09ff61422d41 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.105495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.106313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.106733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.107977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.109788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.113204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.251338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 830/1639] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:12 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:12.256403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.261909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:12.268817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0fd7a-b29f-449c-85f7-0cc30e8f2315 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.339273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.339888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.340196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.340491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.341126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.343900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.442106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 810/1640] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:12 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:12.446068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.461145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29083ed4-42c4-4981-ae37-f9cc99ce4ff4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.467465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.468266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.468661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.468831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.469475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.471383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.484504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 831/1641] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:12.486478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.497453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae047f-3caf-44f9-a06f-838bb6850b36 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.502986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23775e-4a37-4084-902f-879d781fb438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.503594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23775e-4a37-4084-902f-879d781fb438 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.503870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23775e-4a37-4084-902f-879d781fb438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.504197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23775e-4a37-4084-902f-879d781fb438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.504911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23775e-4a37-4084-902f-879d781fb438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.506571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23775e-4a37-4084-902f-879d781fb438 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.522191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 811/1642] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:12.522960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.539172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395b89a-616f-461d-b915-51201a151adb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.544647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.545517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.546012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.546292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] PATH_INFO: `/v3/projects/7a15d71235504c968ae1045ed4913fd0/users/fa7443849e31435da0ff8ffdc9747bd0/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.580732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a15d71235504c968ae1045ed4913fd0, user_id=fa7443849e31435da0ff8ffdc9747bd0, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.595647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.725491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 832/1643] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:12 2022] PUT /identity/v3/projects/7a15d71235504c968ae1045ed4913fd0/users/fa7443849e31435da0ff8ffdc9747bd0/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:12.737372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540496-dd33-4fe6-ad51-8c2a77059de9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.737806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540496-dd33-4fe6-ad51-8c2a77059de9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.737806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56540496-dd33-4fe6-ad51-8c2a77059de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.783206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-56540496-dd33-4fe6-ad51-8c2a77059de9 None None] MFA Rules not processed for user `fa7443849e31435da0ff8ffdc9747bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:12.784622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-56540496-dd33-4fe6-ad51-8c2a77059de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:12.860420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 812/1644] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:12.906359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:12.908861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:12.968889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79569022-91d3-41bd-ba9b-94ed82fd65cc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:12.972539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b979db-228f-472f-9f53-4da28bfdda64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:12.973201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b979db-228f-472f-9f53-4da28bfdda64 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:12.973477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b979db-228f-472f-9f53-4da28bfdda64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:12.973746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b979db-228f-472f-9f53-4da28bfdda64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:12.985172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b979db-228f-472f-9f53-4da28bfdda64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:12.986848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b979db-228f-472f-9f53-4da28bfdda64 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:12.999766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 833/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:13.025224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56540496-dd33-4fe6-ad51-8c2a77059de9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:13.109665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56540496-dd33-4fe6-ad51-8c2a77059de9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:13.114958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:13.115598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.115871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.116288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] PATH_INFO: `/v3/users/fa7443849e31435da0ff8ffdc9747bd0` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.123264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7443849e31435da0ff8ffdc9747bd0)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:13.125319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:13.360866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7443849e31435da0ff8ffdc9747bd0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.361570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7443849e31435da0ff8ffdc9747bd0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.375351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7443849e31435da0ff8ffdc9747bd0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.391558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7443849e31435da0ff8ffdc9747bd0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.456419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7443849e31435da0ff8ffdc9747bd0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:13.465238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 813/1646] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:13 2022] DELETE /identity/v3/users/fa7443849e31435da0ff8ffdc9747bd0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:13.470139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.470451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.470995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.517738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:13.518955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.607752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 834/1647] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:13.617645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:13.619481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:13.702821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec7eef-de37-485f-8fb6-bb930c3c7684 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:13.706449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:13.707041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:13.707889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:13.708153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:13.716934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:13.718349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:13.727849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 814/1648] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:14.209615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.212102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.229535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f4770-80e5-4843-be2d-0919df06cea8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.231271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:14.237050 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.239030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.239720 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.240081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] PATH_INFO: `/v3/users/d31f07ba20b94eb298bc60ab95900cb9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.241911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31f07ba20b94eb298bc60ab95900cb9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.243911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.307456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:14.405760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.407334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.420826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6d889-775a-487a-b175-b06041c1b716 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.425581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.426211 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.426493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.426765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] PATH_INFO: `/v3/projects/7a15d71235504c968ae1045ed4913fd0` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.427886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a15d71235504c968ae1045ed4913fd0)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.429814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.515052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31f07ba20b94eb298bc60ab95900cb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.522567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31f07ba20b94eb298bc60ab95900cb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.523225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31f07ba20b94eb298bc60ab95900cb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.523827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31f07ba20b94eb298bc60ab95900cb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.560367 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a15d71235504c968ae1045ed4913fd0', 'request_id': 'req-bc41bc37-b466-43fc-a2a7-4966b6cebb03'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.568196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a15d71235504c968ae1045ed4913fd0', 'request_id': 'req-bc41bc37-b466-43fc-a2a7-4966b6cebb03'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.573904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a15d71235504c968ae1045ed4913fd0', 'request_id': 'req-bc41bc37-b466-43fc-a2a7-4966b6cebb03'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.615112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a953c631-086e-43e9-af35-2965c79f2d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31f07ba20b94eb298bc60ab95900cb9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.632947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 835/1649] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:14 2022] DELETE /identity/v3/users/d31f07ba20b94eb298bc60ab95900cb9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:14.638120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.638419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.638697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.658525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:14.659641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.697297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] The token cache is being invalidate because project 7a15d71235504c968ae1045ed4913fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:14.697714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.698660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bc41bc37-b466-43fc-a2a7-4966b6cebb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:14.703776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 815/1650] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:14 2022] DELETE /identity/v3/projects/7a15d71235504c968ae1045ed4913fd0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:14.706243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d7186-2a34-4eec-aace-e63659a32dcb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.706791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d7186-2a34-4eec-aace-e63659a32dcb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.707947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d7186-2a34-4eec-aace-e63659a32dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.724008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 836/1651] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:14.733986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.735623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.741597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-455d7186-2a34-4eec-aace-e63659a32dcb None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:14.742883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-455d7186-2a34-4eec-aace-e63659a32dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.751710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 816/1652] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:14.761108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2227a-7fb6-43b6-a910-27ba0741777a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.761388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2227a-7fb6-43b6-a910-27ba0741777a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.761640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2227a-7fb6-43b6-a910-27ba0741777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.784967 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-99e2227a-7fb6-43b6-a910-27ba0741777a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:14.786826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-99e2227a-7fb6-43b6-a910-27ba0741777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:14.802436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 817/1653] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:14.806596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2227a-7fb6-43b6-a910-27ba0741777a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.809755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f14e35-5186-4100-bcbe-67fbfa8ed5e6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.813632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.814232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.814512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.814780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.815549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2227a-7fb6-43b6-a910-27ba0741777a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.820230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.820888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.821162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.821433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.822228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:14.822425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.824044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.824198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.825654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.836201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 837/1654] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:14.836552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 818/1655] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:42:14.840838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.851327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f5a4d-fcfd-4d2c-bd4a-fee0f90edf36 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:14.856141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:14.856821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:14.857162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:14.857459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:14.858145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:14.859962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:14.974706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 838/1656] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/projects => generated 361 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:14.978925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:14.989591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34845a-faa3-44a6-8f8a-f70ef6a12154 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:15.079807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:15.081561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.081561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.081561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.082438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:15.084642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:15.222105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 819/1657] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:14 2022] POST /identity/v3/users => generated 281 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:15.227587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:15.253893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fc332-b8b9-4a1a-b760-e88322b3b50f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:15.259232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:15.260078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.260666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.261192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.262028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:15.263774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:15.275566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 839/1658] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:15.280768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:15.294930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c9ca-e018-4d9e-8fbe-ea2263e6bd59 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:15.304466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182cbad-bfe8-41d1-b949-d07b69efb7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:15.304466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cbad-bfe8-41d1-b949-d07b69efb7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.304466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cbad-bfe8-41d1-b949-d07b69efb7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.304466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cbad-bfe8-41d1-b949-d07b69efb7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.304887 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182cbad-bfe8-41d1-b949-d07b69efb7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:15.306190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182cbad-bfe8-41d1-b949-d07b69efb7d5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:15.323795 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 820/1659] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:15.326300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:15.346157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f7b8d-c0be-4a45-9226-df0668ccfb83 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:15.353990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:15.355363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.355957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.356412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] PATH_INFO: `/v3/projects/27fb265cc1ca4e1d87fae263d13f3cc8/users/8df37385772643ae9783285fc32eabbf/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.375784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fb265cc1ca4e1d87fae263d13f3cc8, user_id=8df37385772643ae9783285fc32eabbf, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:15.380273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:15.459434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 840/1660] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:15 2022] PUT /identity/v3/projects/27fb265cc1ca4e1d87fae263d13f3cc8/users/8df37385772643ae9783285fc32eabbf/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:15.470311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.470599 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.470898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.488592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:15.490889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:15.520160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] MFA Rules not processed for user `8df37385772643ae9783285fc32eabbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:15.521995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:15.630859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad939c8-9d1a-4a61-8ba0-ffbe453cf6e4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:15.638068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:15.639066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.639526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.639992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] PATH_INFO: `/v3/projects/ce9c4b3860a34a54a0e2f41f239973dd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.641678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9c4b3860a34a54a0e2f41f239973dd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:15.644917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:15.650925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 821/1661] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:15.706154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:15.706154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:15.774789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66508cd7-e12a-4933-b46f-d20566e1ec69 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:15.786885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9c4b3860a34a54a0e2f41f239973dd', 'request_id': 'req-677db126-4b0a-4a9c-b7bb-dba24cf84bea'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:15.798908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:15.798908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9c4b3860a34a54a0e2f41f239973dd', 'request_id': 'req-677db126-4b0a-4a9c-b7bb-dba24cf84bea'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:15.818416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9c4b3860a34a54a0e2f41f239973dd', 'request_id': 'req-677db126-4b0a-4a9c-b7bb-dba24cf84bea'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:15.836923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:15.837737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:15.838050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:15.838381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:15.900441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:15.901908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:15.911746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 822/1662] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:15.929051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:15.937100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:16.005935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] The token cache is being invalidate because project ce9c4b3860a34a54a0e2f41f239973dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:16.012523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.012659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb6888-f142-4248-bfc3-cbeb12766697 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:16.012755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.012755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 841/1663] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:15 2022] DELETE /identity/v3/projects/ce9c4b3860a34a54a0e2f41f239973dd => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:16.012905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:16.013171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:16.013342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:16.013607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] PATH_INFO: `/v3/users/8df37385772643ae9783285fc32eabbf` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:16.014698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:16.015082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df37385772643ae9783285fc32eabbf)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:16.017579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:16.017920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:16.033946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677db126-4b0a-4a9c-b7bb-dba24cf84bea admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:16.041159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:16.042130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:16.042537 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:16.043064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] PATH_INFO: `/v3/users/de4b7de8b4ac46e88f252040f37d4533` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:16.044745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4b7de8b4ac46e88f252040f37d4533)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:16.047238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:16.463527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df37385772643ae9783285fc32eabbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.464348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df37385772643ae9783285fc32eabbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.478558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df37385772643ae9783285fc32eabbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.486306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df37385772643ae9783285fc32eabbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.551614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4b7de8b4ac46e88f252040f37d4533'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.558967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4b7de8b4ac46e88f252040f37d4533'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.562501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4b7de8b4ac46e88f252040f37d4533'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.562501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4b7de8b4ac46e88f252040f37d4533'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.581111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e9c3a2d6-e53c-48ba-a419-bd235cf7995c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df37385772643ae9783285fc32eabbf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.589540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 823/1664] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:15 2022] DELETE /identity/v3/users/8df37385772643ae9783285fc32eabbf => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:16.593555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:16.593842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:16.594252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:16.617773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:16.620090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:16.692407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 824/1665] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:16.697861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4b7de8b4ac46e88f252040f37d4533'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:16.704710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:16.707743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:16.718045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 842/1666] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:16 2022] DELETE /identity/v3/users/de4b7de8b4ac46e88f252040f37d4533 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:16.799394 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f75f-0bc1-438d-8690-b9f6886882d1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:16.861038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:16.861609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:16.864023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:16.864288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:16.953307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:16.954957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:16.993047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 825/1667] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:17.304390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:17.306807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:17.334293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:17.336902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:17.355917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca3bf9-0ad1-4c83-aa11-7e16ebeea886 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:17.365691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:17.366932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:17.368425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:17.368953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] PATH_INFO: `/v3/projects/5141a1986a044b2b900ae7df592f4653` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:17.371340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5141a1986a044b2b900ae7df592f4653)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:17.374291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c195b2-3855-4072-b816-9907268264ef service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:17.376996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:17.386491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:17.387461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:17.387915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:17.388345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] PATH_INFO: `/v3/users/9ef2c1c50ae74169a2e9dec88382f0e3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:17.390589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef2c1c50ae74169a2e9dec88382f0e3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:17.400355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:17.520206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5141a1986a044b2b900ae7df592f4653', 'request_id': 'req-3f4c13f4-0a1b-4977-b974-faa9973ae725'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.526949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5141a1986a044b2b900ae7df592f4653', 'request_id': 'req-3f4c13f4-0a1b-4977-b974-faa9973ae725'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.535525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5141a1986a044b2b900ae7df592f4653', 'request_id': 'req-3f4c13f4-0a1b-4977-b974-faa9973ae725'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.664277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] The token cache is being invalidate because project 5141a1986a044b2b900ae7df592f4653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:17.671004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.671004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.671004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 843/1668] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:17 2022] DELETE /identity/v3/projects/5141a1986a044b2b900ae7df592f4653 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:17.671004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:17.672281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:17.714654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef2c1c50ae74169a2e9dec88382f0e3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.715499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef2c1c50ae74169a2e9dec88382f0e3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.739693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef2c1c50ae74169a2e9dec88382f0e3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.747259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef2c1c50ae74169a2e9dec88382f0e3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.752256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c13f4-0a1b-4977-b974-faa9973ae725 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:17.757113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:17.757739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:17.758012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:17.758277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] PATH_INFO: `/v3/users/e5329aef72544602ac79439edb287d19` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:17.759424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5329aef72544602ac79439edb287d19)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:17.761410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:17.811872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef2c1c50ae74169a2e9dec88382f0e3'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.818921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 826/1669] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:17 2022] DELETE /identity/v3/users/9ef2c1c50ae74169a2e9dec88382f0e3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:17.822885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:17.824218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:17.890443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd87cbd-6271-43fc-b9de-7d11e937055a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:17.895067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:17.895698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:17.896020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:17.896293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] PATH_INFO: `/v3/projects/27fb265cc1ca4e1d87fae263d13f3cc8` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:17.897466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fb265cc1ca4e1d87fae263d13f3cc8)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:17.899374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:17.954975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5329aef72544602ac79439edb287d19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.965397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5329aef72544602ac79439edb287d19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.975869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5329aef72544602ac79439edb287d19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:17.975869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5329aef72544602ac79439edb287d19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.030184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fb265cc1ca4e1d87fae263d13f3cc8', 'request_id': 'req-c76f7867-86f9-42d9-a6ec-763deda67f34'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.034931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c12b07a1-90ee-4bce-9122-3a3eb4f051a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5329aef72544602ac79439edb287d19'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.037573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fb265cc1ca4e1d87fae263d13f3cc8', 'request_id': 'req-c76f7867-86f9-42d9-a6ec-763deda67f34'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.044718 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fb265cc1ca4e1d87fae263d13f3cc8', 'request_id': 'req-c76f7867-86f9-42d9-a6ec-763deda67f34'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.080032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 844/1670] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:17 2022] DELETE /identity/v3/users/e5329aef72544602ac79439edb287d19 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:18.081431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.081710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.082346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.107715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:18.112218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:18.115817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:18.142839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] The token cache is being invalidate because project 27fb265cc1ca4e1d87fae263d13f3cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:18.143552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.143950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c76f7867-86f9-42d9-a6ec-763deda67f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:18.154914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 827/1671] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:17 2022] DELETE /identity/v3/projects/27fb265cc1ca4e1d87fae263d13f3cc8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:18.159669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:18.162036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca4941-3d35-4eef-9614-39e0165bab4b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.163255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca4941-3d35-4eef-9614-39e0165bab4b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.163517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca4941-3d35-4eef-9614-39e0165bab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.215149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8eca4941-3d35-4eef-9614-39e0165bab4b None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:18.220692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8eca4941-3d35-4eef-9614-39e0165bab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:18.277605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 845/1672] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:18.314634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:18.316928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:18.371434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 828/1673] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:18.381733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec813-3ecb-431e-a031-a822d4398377 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.382132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec813-3ecb-431e-a031-a822d4398377 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.382681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ec813-3ecb-431e-a031-a822d4398377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.412418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69ede6-0bc9-4a06-b2a8-8ef2270446dc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:18.417070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:18.417951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.418374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-232ec813-3ecb-431e-a031-a822d4398377 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:18.418570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.419136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.419651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-232ec813-3ecb-431e-a031-a822d4398377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:18.432510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 829/1674] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:18.433559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ec813-3ecb-431e-a031-a822d4398377 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:18.451259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:18.451259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:18.465490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ec813-3ecb-431e-a031-a822d4398377 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:18.466308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 846/1675] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:18.472202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:18.472917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.473907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.474193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.475175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:18.475567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:18.477352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:18.490782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 830/1676] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:18.495317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:18.505546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24d0bf-feb7-4017-9d37-99b41b44c373 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:18.517887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:18.517887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.517887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.517887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.518240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:18.520692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:18.667299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 847/1677] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:18 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:18.667986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:18.679188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2d4f0-f10a-4e2f-ae4e-2767401ec90f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:18.799169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:18.885482 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:18.886092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:18.886387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:18.886639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:18.887286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:18.889278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.048492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.051373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 831/1678] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:18 2022] POST /identity/v3/users => generated 287 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:19.051947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.053003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.071575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daea73-df81-48ff-ab6b-91150084b38d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.074132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd089a15-edcd-4f1c-a08d-170eb717d637 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.082235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.083454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.083791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.084068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] PATH_INFO: `/v3/projects/60893b857b704559a442d1f5948a3eaa` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.089070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60893b857b704559a442d1f5948a3eaa)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.089070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.095079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.097943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.098241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.099078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.099746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.101382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.112297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 832/1679] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:19.125225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.135467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ee721-aa6e-4e85-889c-538f03132081 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.140190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.140961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.141305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.141675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.142373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.144089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.155447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 833/1680] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:19.159558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.169518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fde952-4ed7-4247-a400-3d43517f7b0e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.174098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.174676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.175030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.175302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] PATH_INFO: `/v3/projects/ab31dd16455443a5b0a05e30aab66418/users/4d5bd861226244e0a3bd6a7ff5a041f5/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.189281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab31dd16455443a5b0a05e30aab66418, user_id=4d5bd861226244e0a3bd6a7ff5a041f5, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.191963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.329662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 834/1681] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:19 2022] PUT /identity/v3/projects/ab31dd16455443a5b0a05e30aab66418/users/4d5bd861226244e0a3bd6a7ff5a041f5/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:19.330494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.332656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.400821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60893b857b704559a442d1f5948a3eaa', 'request_id': 'req-c3157355-be92-4ff0-aaa9-1dd3d830c58f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.407115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60893b857b704559a442d1f5948a3eaa', 'request_id': 'req-c3157355-be92-4ff0-aaa9-1dd3d830c58f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.410197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4870cd-bf6a-410c-a238-e74d3a12a6aa admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.414352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60893b857b704559a442d1f5948a3eaa', 'request_id': 'req-c3157355-be92-4ff0-aaa9-1dd3d830c58f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.479170 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.479804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.480079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.480792 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] PATH_INFO: `/v3/projects/d5d1ad027e2548bca6f07f82abf8709b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.481893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d1ad027e2548bca6f07f82abf8709b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.483480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.529054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] The token cache is being invalidate because project 60893b857b704559a442d1f5948a3eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:19.530093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.530361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c3157355-be92-4ff0-aaa9-1dd3d830c58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.532139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 848/1682] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:19 2022] DELETE /identity/v3/projects/60893b857b704559a442d1f5948a3eaa => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:19.537692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56503da-59b8-4c06-9c48-a9d7215be78e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.537931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56503da-59b8-4c06-9c48-a9d7215be78e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.538270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56503da-59b8-4c06-9c48-a9d7215be78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.557449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a56503da-59b8-4c06-9c48-a9d7215be78e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:19.558670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a56503da-59b8-4c06-9c48-a9d7215be78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.566047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 849/1683] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:19.567175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.567451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.567714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.586757 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:19.587923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.594834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d1ad027e2548bca6f07f82abf8709b', 'request_id': 'req-9400e388-427d-4cc2-9ef3-99e39e85b2a5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.601624 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d1ad027e2548bca6f07f82abf8709b', 'request_id': 'req-9400e388-427d-4cc2-9ef3-99e39e85b2a5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.606950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d1ad027e2548bca6f07f82abf8709b', 'request_id': 'req-9400e388-427d-4cc2-9ef3-99e39e85b2a5'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.618035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:19.650729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 850/1684] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:19.656586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.656586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.697111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] The token cache is being invalidate because project d5d1ad027e2548bca6f07f82abf8709b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:19.697349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.698019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-9400e388-427d-4cc2-9ef3-99e39e85b2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.699814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 835/1685] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:19 2022] DELETE /identity/v3/projects/d5d1ad027e2548bca6f07f82abf8709b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:19.701177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.701461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.701752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.712256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a687f6d-ee77-4d1d-94c8-93138377b287 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.716296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.716952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.717227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.717497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.719259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.722141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:19.725257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.732476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 836/1686] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:19.733266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.734657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:19.737042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.738479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.748843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 851/1687] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:19.749480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.750091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21535-2f7b-4821-95e8-7dd4b08a9ef8 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.755017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.755772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.755963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.756166 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] PATH_INFO: `/v3/users/11cbbc57a64840faa52d292e2a438581` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.757350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11cbbc57a64840faa52d292e2a438581)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.759270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.759693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6444b-c1c3-438c-b702-307e3764c7fe service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.764545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.765305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.765754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.766022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.766658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:19.766954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.768598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.782048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 852/1688] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:19.786866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.796554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d613a-4fae-48fe-97aa-d98370f248e4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.801289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.801888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:19.802127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:19.802389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:19.803007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:19.804934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:19.909585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 853/1689] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:19 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:19.913989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:19.980798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11cbbc57a64840faa52d292e2a438581'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.982373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11cbbc57a64840faa52d292e2a438581'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.993959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68daed3e-f50a-4a5a-aacf-ea0050838408 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:19.995700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11cbbc57a64840faa52d292e2a438581'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:19.999240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:19.999857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.003918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.003918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.003918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.003918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.004301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11cbbc57a64840faa52d292e2a438581'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.128463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11cbbc57a64840faa52d292e2a438581'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.135303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 837/1690] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:19 2022] DELETE /identity/v3/users/11cbbc57a64840faa52d292e2a438581 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:20.190575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 854/1691] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:19 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:20.192732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.194200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.259296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61caf6d-eb21-4a94-a1f0-ca16d036929c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.263834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.264442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.264735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.265004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.265636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.267218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.277563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 838/1692] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:20.282277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.294305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02672953-3d28-48ab-ab2e-6b15be044b91 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.300642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989047d-7bb7-47b2-83d5-4c190227e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.301814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989047d-7bb7-47b2-83d5-4c190227e4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.302562 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989047d-7bb7-47b2-83d5-4c190227e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.303038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989047d-7bb7-47b2-83d5-4c190227e4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.304367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989047d-7bb7-47b2-83d5-4c190227e4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.305957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989047d-7bb7-47b2-83d5-4c190227e4b6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.325738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.326076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 855/1693] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:20.348696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7c750-8fea-4742-9cc6-7fce83cdb6ec admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.349532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.350305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.350788 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.350869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] PATH_INFO: `/v3/projects/ebf9a6d2fc3e4be79017d01f0fea5e04/users/3eec7ecb00e24f4ba98a07ed65f5e89f/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.368264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf9a6d2fc3e4be79017d01f0fea5e04, user_id=3eec7ecb00e24f4ba98a07ed65f5e89f, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.372399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.462693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 839/1694] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:20 2022] PUT /identity/v3/projects/ebf9a6d2fc3e4be79017d01f0fea5e04/users/3eec7ecb00e24f4ba98a07ed65f5e89f/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:20.470589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.470877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.471198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.500164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] MFA Rules not processed for user `3eec7ecb00e24f4ba98a07ed65f5e89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:20.501305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.567139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 856/1695] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:20.572084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.625967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.627594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.673262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e91f5-05f7-442e-bc63-86e1ae87b333 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.678843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.679612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.679952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.680281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.681083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.683249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.725567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fad5a0-9065-4cf8-8159-93af52b8cebf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.730573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.731276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.731977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.731977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] PATH_INFO: `/v3/projects/aa3345102dea488096fbba31c8a9c2c4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.733244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3345102dea488096fbba31c8a9c2c4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.735251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.799666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 840/1696] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:20.803607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:20.838480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3345102dea488096fbba31c8a9c2c4', 'request_id': 'req-71e7aa88-8701-4778-b5e2-26b1d62011c1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.850857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3345102dea488096fbba31c8a9c2c4', 'request_id': 'req-71e7aa88-8701-4778-b5e2-26b1d62011c1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.857512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3345102dea488096fbba31c8a9c2c4', 'request_id': 'req-71e7aa88-8701-4778-b5e2-26b1d62011c1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.871940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d8ff-6e2e-48c0-9537-f8b6dac614e7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:20.931005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:20.932334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.932652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.932928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.933621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:20.935972 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:20.936112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] The token cache is being invalidate because project aa3345102dea488096fbba31c8a9c2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:20.936545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.937306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-71e7aa88-8701-4778-b5e2-26b1d62011c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:20.939244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 857/1697] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:20 2022] DELETE /identity/v3/projects/aa3345102dea488096fbba31c8a9c2c4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:20.943862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a8788-df2b-47d7-bb6a-f9a81076f2ce None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.944342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a8788-df2b-47d7-bb6a-f9a81076f2ce None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.944642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a8788-df2b-47d7-bb6a-f9a81076f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:20.966331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cd6a8788-df2b-47d7-bb6a-f9a81076f2ce None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:20.967665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cd6a8788-df2b-47d7-bb6a-f9a81076f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:20.976265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 858/1698] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:20.983736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8203-ad16-4af2-a294-23d1fe64c343 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:20.984013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8203-ad16-4af2-a294-23d1fe64c343 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:20.984283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a8203-ad16-4af2-a294-23d1fe64c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.004208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7d5a8203-ad16-4af2-a294-23d1fe64c343 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.005425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7d5a8203-ad16-4af2-a294-23d1fe64c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.014072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 859/1699] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:21.017950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a8203-ad16-4af2-a294-23d1fe64c343 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.030084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 841/1700] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:20 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:21.030512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a8203-ad16-4af2-a294-23d1fe64c343 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.032493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.034392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.035814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.036480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.037484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.037763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.038412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:21.038715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.040488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.047616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e1b6d-9dc3-4e53-86a0-149871e1816a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.055879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 860/1701] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:42:21.056043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.056043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.056043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.056043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.056331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.056641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.061706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.063789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:21.069953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 842/1702] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:21.073940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.077610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09670-5206-4740-bb2a-828ef9280f49 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.083273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.084655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.084655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.084655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.085186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.087124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.088719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f60bff-e413-4718-adc4-404b86a8e74f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.093706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.094305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.094580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.094846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.095479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.097722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.109483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 843/1703] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:21.113580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.130652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fefbe-71ee-4c65-850a-3f189685a0dc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.135333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb216d6-739d-4b6b-9cbb-956034c65bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.135978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb216d6-739d-4b6b-9cbb-956034c65bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.136249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb216d6-739d-4b6b-9cbb-956034c65bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.136538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb216d6-739d-4b6b-9cbb-956034c65bb9 admin admin] PATH_INFO: `/v3/projects/9acc22cd60ae4580b1ddbe9ecaebb2d5/users/691c531002d44406a60afbdff849431d/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.155577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:21.191907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb216d6-739d-4b6b-9cbb-956034c65bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9acc22cd60ae4580b1ddbe9ecaebb2d5, user_id=691c531002d44406a60afbdff849431d, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.208647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb216d6-739d-4b6b-9cbb-956034c65bb9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.216593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 861/1704] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:21.221132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.295159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81cb5a-3f86-4997-a8c3-57778d8130b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.297455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 844/1705] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:21 2022] PUT /identity/v3/projects/9acc22cd60ae4580b1ddbe9ecaebb2d5/users/691c531002d44406a60afbdff849431d/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:21.298723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6289e1-5b35-4b49-9529-dcfe865fb0c8 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.299380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6289e1-5b35-4b49-9529-dcfe865fb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.299655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6289e1-5b35-4b49-9529-dcfe865fb0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.335134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9a6289e1-5b35-4b49-9529-dcfe865fb0c8 None None] MFA Rules not processed for user `4d5bd861226244e0a3bd6a7ff5a041f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.336845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9a6289e1-5b35-4b49-9529-dcfe865fb0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.365626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.366497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.366935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.367342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.368109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.370472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.406872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 845/1706] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:21.408118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ee2f7-284f-4c13-9be8-1684001f5bc0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.408398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ee2f7-284f-4c13-9be8-1684001f5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.408696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ee2f7-284f-4c13-9be8-1684001f5bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.437445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b35ee2f7-284f-4c13-9be8-1684001f5bc0 None None] MFA Rules not processed for user `691c531002d44406a60afbdff849431d`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.438627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b35ee2f7-284f-4c13-9be8-1684001f5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.469585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 862/1707] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:21.470596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.472145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.508297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 846/1708] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:21.509516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ee2f7-284f-4c13-9be8-1684001f5bc0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.522316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ee2f7-284f-4c13-9be8-1684001f5bc0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.526999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.527591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.527865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.528132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.528798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.530738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.532976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c1ada-eed8-4b82-8de5-3010184981e7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.537212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.538016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.538344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.538612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.541477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 847/1709] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:21.543070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.547652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.549110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.552660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaff84d-91b4-4a6d-b045-eeb984f62db9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.557628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.558194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.558292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 863/1710] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:21.558470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.558734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.559140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.559389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.561290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.569886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb02a7-a276-4cdd-b65a-915017717218 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.578362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.578968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.579364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.579632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.580327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.582539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.592842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 864/1711] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:21.598191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.607588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97ea44-d102-4777-82c2-130d50ba7b0b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.612553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c183ae-b5ca-4268-8cd9-7bf898a31fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.613226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c183ae-b5ca-4268-8cd9-7bf898a31fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.613497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c183ae-b5ca-4268-8cd9-7bf898a31fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.613770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c183ae-b5ca-4268-8cd9-7bf898a31fdb admin admin] PATH_INFO: `/v3/projects/901773464d6c448c8c24a11f74cfc5d8/users/72610ded74de474b9e2ed9fe22b06206/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.629153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c183ae-b5ca-4268-8cd9-7bf898a31fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=901773464d6c448c8c24a11f74cfc5d8, user_id=72610ded74de474b9e2ed9fe22b06206, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.631857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c183ae-b5ca-4268-8cd9-7bf898a31fdb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.652647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 848/1712] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:21.657026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.721046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afab15-7bdb-4a82-93b6-5979f69d2f8c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.725862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.726458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.726734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.727003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.727667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.729612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.732070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 865/1713] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:21 2022] PUT /identity/v3/projects/901773464d6c448c8c24a11f74cfc5d8/users/72610ded74de474b9e2ed9fe22b06206/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:21.743600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b0ca2-9420-4327-83a0-956acc3b5bb6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.743913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b0ca2-9420-4327-83a0-956acc3b5bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.744204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b0ca2-9420-4327-83a0-956acc3b5bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.752199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:21.772942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-711b0ca2-9420-4327-83a0-956acc3b5bb6 None None] MFA Rules not processed for user `72610ded74de474b9e2ed9fe22b06206`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:21.774146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-711b0ca2-9420-4327-83a0-956acc3b5bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:21.823014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 849/1714] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:21.827053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.838127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e44ce-0ecb-4a34-a691-c918f02309ee admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.851281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 866/1715] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:21.859013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b0ca2-9420-4327-83a0-956acc3b5bb6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.918160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.919104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.919316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.919576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.920227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.921859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.949360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b0ca2-9420-4327-83a0-956acc3b5bb6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.954148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.954753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.955089 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.955357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.955983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.956486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 850/1716] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:21.958421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:21.961305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:21.971500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953755b-880b-495a-9182-b77d34a00611 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:21.976866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:21.977514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:21.977796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:21.978095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] PATH_INFO: `/v3/projects/171cf225f3a347fca9fe31be0afc74da/users/fff971ffdcb34d38a1315181ad964691/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:21.993885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=171cf225f3a347fca9fe31be0afc74da, user_id=fff971ffdcb34d38a1315181ad964691, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:21.996578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.087335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 851/1717] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:21 2022] PUT /identity/v3/projects/171cf225f3a347fca9fe31be0afc74da/users/fff971ffdcb34d38a1315181ad964691/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:22.089383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 867/1718] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:21 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:22.093489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.094529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.157757 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdd41-39af-4383-8222-57a5fd7e0f55 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.158749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77427d2-5724-4e2c-a3e1-3465e2056784 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.163465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.171873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.171873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.172105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.172234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.172323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.172409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.172534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.172534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.172534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.172755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.172838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.180467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 868/1719] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:22.181512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.191647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51cfe4-4345-49fc-be10-1fb66e29f493 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.196352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774eeb6-f880-4bcc-97b5-449157251a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.197049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774eeb6-f880-4bcc-97b5-449157251a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.197355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774eeb6-f880-4bcc-97b5-449157251a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.197636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774eeb6-f880-4bcc-97b5-449157251a3c admin admin] PATH_INFO: `/v3/projects/171cf225f3a347fca9fe31be0afc74da/users/fff971ffdcb34d38a1315181ad964691/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.199501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774eeb6-f880-4bcc-97b5-449157251a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=171cf225f3a347fca9fe31be0afc74da, user_id=fff971ffdcb34d38a1315181ad964691, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.202320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774eeb6-f880-4bcc-97b5-449157251a3c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.212846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 869/1720] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:22 2022] PUT /identity/v3/projects/171cf225f3a347fca9fe31be0afc74da/users/fff971ffdcb34d38a1315181ad964691/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:22.224306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5afe-9cb6-4364-8749-1b090f24aa01 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.224830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5afe-9cb6-4364-8749-1b090f24aa01 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.225314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c5afe-9cb6-4364-8749-1b090f24aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.256460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-339c5afe-9cb6-4364-8749-1b090f24aa01 None None] MFA Rules not processed for user `fff971ffdcb34d38a1315181ad964691`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:22.257674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-339c5afe-9cb6-4364-8749-1b090f24aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:22.323061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 852/1721] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:22 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:22.327278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.338110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88da02-20c0-4916-b474-c764961b3de3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.339950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 870/1722] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:22.356022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5afe-9cb6-4364-8749-1b090f24aa01 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.418277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.419020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.419190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c5afe-9cb6-4364-8749-1b090f24aa01 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.419477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.419840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.420609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.422463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.423439 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.424775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.425064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.425322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.427957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:22.434625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 853/1723] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:22.438582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.450352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f261e-ae65-4812-8136-a139d62e7944 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.455912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.457336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.457627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.457902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] PATH_INFO: `/v3/projects/511d2e0bc7f14de2baa17cfdb11e4990/users/c69cd0d4388648c9829756332a9b2936/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.478283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511d2e0bc7f14de2baa17cfdb11e4990, user_id=c69cd0d4388648c9829756332a9b2936, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.481399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.494161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.495727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.505694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 871/1724] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:22.743386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 854/1725] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:22 2022] PUT /identity/v3/projects/511d2e0bc7f14de2baa17cfdb11e4990/users/c69cd0d4388648c9829756332a9b2936/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:22.747455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.758060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165e6e9-eb12-4b8e-99a8-1db24bc96273 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.820101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737bbb2-beb3-4f71-a941-678423392bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.820769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737bbb2-beb3-4f71-a941-678423392bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.821048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737bbb2-beb3-4f71-a941-678423392bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.821316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737bbb2-beb3-4f71-a941-678423392bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.821953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737bbb2-beb3-4f71-a941-678423392bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.823558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737bbb2-beb3-4f71-a941-678423392bd0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.833565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 872/1726] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:22.837720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:22.848102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca872e7e-b17d-48f9-a3c6-ba028d20e470 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:22.852565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:22.853200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.853475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.853769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] PATH_INFO: `/v3/projects/511d2e0bc7f14de2baa17cfdb11e4990/users/c69cd0d4388648c9829756332a9b2936/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.855635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=511d2e0bc7f14de2baa17cfdb11e4990, user_id=c69cd0d4388648c9829756332a9b2936, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:22.858287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:22.868272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 855/1727] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:22 2022] PUT /identity/v3/projects/511d2e0bc7f14de2baa17cfdb11e4990/users/c69cd0d4388648c9829756332a9b2936/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:22.878547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ac375-8e9b-4592-8316-400f735ec1d6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:22.878547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ac375-8e9b-4592-8316-400f735ec1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:22.879035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ac375-8e9b-4592-8316-400f735ec1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:22.909081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cf3ac375-8e9b-4592-8316-400f735ec1d6 None None] MFA Rules not processed for user `c69cd0d4388648c9829756332a9b2936`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:22.910881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cf3ac375-8e9b-4592-8316-400f735ec1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:23.024477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 873/1728] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:23.125532 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.128018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:23.210869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf41a-7145-417c-bb06-675909ca15aa admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.215495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e4e1-3097-474e-ae75-7c8a13a1b986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.216698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e4e1-3097-474e-ae75-7c8a13a1b986 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.226861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e4e1-3097-474e-ae75-7c8a13a1b986 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.226861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e4e1-3097-474e-ae75-7c8a13a1b986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.236136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e4e1-3097-474e-ae75-7c8a13a1b986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.237609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e4e1-3097-474e-ae75-7c8a13a1b986 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:23.247807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 856/1729] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:23.521598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:23.819527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ac375-8e9b-4592-8316-400f735ec1d6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:23.880204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ac375-8e9b-4592-8316-400f735ec1d6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:23.884843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:23.885468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:23.885748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:23.886015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] PATH_INFO: `/v3/users/72610ded74de474b9e2ed9fe22b06206` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:23.887133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72610ded74de474b9e2ed9fe22b06206)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:23.889136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:24.121413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72610ded74de474b9e2ed9fe22b06206'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.130205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72610ded74de474b9e2ed9fe22b06206'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.130934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72610ded74de474b9e2ed9fe22b06206'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.131640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72610ded74de474b9e2ed9fe22b06206'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.232189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72610ded74de474b9e2ed9fe22b06206'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:24.250378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 874/1730] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:23 2022] DELETE /identity/v3/users/72610ded74de474b9e2ed9fe22b06206 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:24.255278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778526-0038-4987-8bbb-41cf9f498877 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:24.256974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:24.257464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778526-0038-4987-8bbb-41cf9f498877 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:24.258721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778526-0038-4987-8bbb-41cf9f498877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:24.277017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b6778526-0038-4987-8bbb-41cf9f498877 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:24.278206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b6778526-0038-4987-8bbb-41cf9f498877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:24.348895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 857/1731] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:24.358796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:24.360257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:24.425982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a73df-d868-4e04-8d33-d706130b975e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:24.432933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:24.433573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:24.433901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:24.434218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:24.446314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:24.447860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:24.460277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 875/1732] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:24.480628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b30e0-b5f5-46c8-96c2-4b794e1efe8c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:24.481207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b30e0-b5f5-46c8-96c2-4b794e1efe8c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:24.481910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b30e0-b5f5-46c8-96c2-4b794e1efe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:24.513919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7a9b30e0-b5f5-46c8-96c2-4b794e1efe8c None None] MFA Rules not processed for user `4d5bd861226244e0a3bd6a7ff5a041f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:24.515222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7a9b30e0-b5f5-46c8-96c2-4b794e1efe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:24.586097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 858/1733] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:24.923015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:24.924707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:24.955932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab312e9-3410-4b04-9a54-a5d150cdb3d5 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:24.961841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:24.962552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:24.962897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:24.963234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] PATH_INFO: `/v3/projects/901773464d6c448c8c24a11f74cfc5d8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:24.964465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=901773464d6c448c8c24a11f74cfc5d8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:24.966452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.098617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901773464d6c448c8c24a11f74cfc5d8', 'request_id': 'req-e050a8da-8cbf-4580-90f6-a4088b66b350'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.104402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901773464d6c448c8c24a11f74cfc5d8', 'request_id': 'req-e050a8da-8cbf-4580-90f6-a4088b66b350'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.111233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901773464d6c448c8c24a11f74cfc5d8', 'request_id': 'req-e050a8da-8cbf-4580-90f6-a4088b66b350'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.234935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:25.269848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] The token cache is being invalidate because project 901773464d6c448c8c24a11f74cfc5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:25.270291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.271078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.272881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 876/1734] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:24 2022] DELETE /identity/v3/projects/901773464d6c448c8c24a11f74cfc5d8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:25.277077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b30e0-b5f5-46c8-96c2-4b794e1efe8c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.291523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b30e0-b5f5-46c8-96c2-4b794e1efe8c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.366896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.367834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.368181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.368672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] PATH_INFO: `/v3/users/c69cd0d4388648c9829756332a9b2936` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.371399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69cd0d4388648c9829756332a9b2936)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.374245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.678154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69cd0d4388648c9829756332a9b2936'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.678828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69cd0d4388648c9829756332a9b2936'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.690758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69cd0d4388648c9829756332a9b2936'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.697811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69cd0d4388648c9829756332a9b2936'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.777565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:25.778935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:25.782858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69cd0d4388648c9829756332a9b2936'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:25.789937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 859/1735] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:25 2022] DELETE /identity/v3/users/c69cd0d4388648c9829756332a9b2936 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:25.839707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050a8da-8cbf-4580-90f6-a4088b66b350 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:25.898121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cdd25-6d62-412e-acfa-720d5d0ad36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:25.898121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cdd25-6d62-412e-acfa-720d5d0ad36f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:25.898121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cdd25-6d62-412e-acfa-720d5d0ad36f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:25.898385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cdd25-6d62-412e-acfa-720d5d0ad36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:25.900182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0d9cdd25-6d62-412e-acfa-720d5d0ad36f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:25.961271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cdd25-6d62-412e-acfa-720d5d0ad36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:25.962989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cdd25-6d62-412e-acfa-720d5d0ad36f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:25.965199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:25.973177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 877/1736] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:26.231469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:26.237456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:26.322065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ef466-0da5-4ad5-97cc-fad2e16ea963 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:26.328648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:26.331565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:26.331565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:26.331565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] PATH_INFO: `/v3/projects/511d2e0bc7f14de2baa17cfdb11e4990` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:26.332094 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=511d2e0bc7f14de2baa17cfdb11e4990)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:26.334928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:26.484389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511d2e0bc7f14de2baa17cfdb11e4990', 'request_id': 'req-bce4c92b-f24b-43e1-b449-31046eec8df4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:26.491011 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511d2e0bc7f14de2baa17cfdb11e4990', 'request_id': 'req-bce4c92b-f24b-43e1-b449-31046eec8df4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:26.500897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511d2e0bc7f14de2baa17cfdb11e4990', 'request_id': 'req-bce4c92b-f24b-43e1-b449-31046eec8df4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:26.570144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:26.574971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] The token cache is being invalidate because project 511d2e0bc7f14de2baa17cfdb11e4990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:26.577786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:26.577786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-bce4c92b-f24b-43e1-b449-31046eec8df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:26.577786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 860/1737] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:26 2022] DELETE /identity/v3/projects/511d2e0bc7f14de2baa17cfdb11e4990 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:26.582469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14c681-1158-4c21-b54b-6a616678c3e8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:26.582752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14c681-1158-4c21-b54b-6a616678c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:26.583024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14c681-1158-4c21-b54b-6a616678c3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:26.602618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5f14c681-1158-4c21-b54b-6a616678c3e8 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:26.603809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5f14c681-1158-4c21-b54b-6a616678c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:26.672472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 878/1738] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:26.680582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a99691-f60e-4f43-ab44-f4eab746738a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:26.680889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a99691-f60e-4f43-ab44-f4eab746738a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:26.688631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a99691-f60e-4f43-ab44-f4eab746738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:26.701445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-69a99691-f60e-4f43-ab44-f4eab746738a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:26.702804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-69a99691-f60e-4f43-ab44-f4eab746738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:26.711894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 861/1739] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:26.717710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14c681-1158-4c21-b54b-6a616678c3e8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:26.726930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14c681-1158-4c21-b54b-6a616678c3e8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:26.732370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:26.733064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:26.733395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:26.734821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:26.734821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:26.734821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:26.736481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:26.750705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 879/1740] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:42:26.760602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a99691-f60e-4f43-ab44-f4eab746738a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:26.770876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a99691-f60e-4f43-ab44-f4eab746738a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:26.776314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:26.777138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:26.777549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:26.777776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:26.778404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:26.780777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:26.901034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 862/1741] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:26 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:26.902116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:26.913100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02884a4-f77c-4db9-8a35-07db7fad64da admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:26.972192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:26.972902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:26.973110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:26.973383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:26.974013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:26.976732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:27.072861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 880/1742] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:26 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:27.077707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:27.088618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592be1a-e7e1-4efe-b938-186174200b5b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:27.093476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:27.094070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:27.094344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:27.094610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:27.095246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:27.096876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:27.107068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 863/1743] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:27.111253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:27.124012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223403e-5f33-4e1a-b0a1-f32523fbb675 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:27.132997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5124f-bcc3-491e-a56e-40af05481553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:27.133600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5124f-bcc3-491e-a56e-40af05481553 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:27.133870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5124f-bcc3-491e-a56e-40af05481553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:27.134135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5124f-bcc3-491e-a56e-40af05481553 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:27.134776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5124f-bcc3-491e-a56e-40af05481553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:27.136366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5124f-bcc3-491e-a56e-40af05481553 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:27.148372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 881/1744] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:27.152630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:27.163012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe897ab-1fad-4d0f-aac2-b09b44fa68db admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:27.167451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:27.168081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:27.168373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:27.168656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] PATH_INFO: `/v3/projects/953b27767c8b497faa18bbfa6f20f92b/users/dc3576435d474a888e33963003d2d426/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:27.183028 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=953b27767c8b497faa18bbfa6f20f92b, user_id=dc3576435d474a888e33963003d2d426, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:27.185814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:27.252166 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 864/1745] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:27 2022] PUT /identity/v3/projects/953b27767c8b497faa18bbfa6f20f92b/users/dc3576435d474a888e33963003d2d426/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:27.263731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:27.264014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:27.264315 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:27.292338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] MFA Rules not processed for user `dc3576435d474a888e33963003d2d426`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:27.293552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:27.360090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 882/1746] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:27.373258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:27.375124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:27.461461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:27.481710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a42d-5db3-41d3-8469-b7bd337a4de0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:27.486793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:27.488255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:27.488877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:27.489306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:27.492097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:27.511059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:27.512552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:27.531158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 865/1747] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:27.890307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:27.960977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:27.962321 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:27.967744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:28.030300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223456d-38c2-4c0a-86e4-f32b1ed6641d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:28.035669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:28.036570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:28.036941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:28.037452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:28.039540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:28.109999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:28.111581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:28.123488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 883/1748] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:29.413262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:29.925230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:30.981305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:32.180298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:32.344301 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:33.404809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:33.406439 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:33.487424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab2120-c66f-40fd-aedd-875e3589046a service glance] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:33.498948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:33.500116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:33.500688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:33.501167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] PATH_INFO: `/v3/users/a124ce6488f94a84a725330c79199df2` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:33.504274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a124ce6488f94a84a725330c79199df2)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:33.506402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:33.629576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:33.717236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a124ce6488f94a84a725330c79199df2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:33.717889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a124ce6488f94a84a725330c79199df2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:33.730101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a124ce6488f94a84a725330c79199df2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:33.736988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a124ce6488f94a84a725330c79199df2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:33.863197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5f449685-31fe-4a93-b273-53effa4d46b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a124ce6488f94a84a725330c79199df2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:33.869515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 866/1749] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:33 2022] DELETE /identity/v3/users/a124ce6488f94a84a725330c79199df2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:33.995879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:34.238954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:34.249384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ddab0-0626-4dec-a7bf-2074b12dc691 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:34.314884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:34.316494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:34.316926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:34.317964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] PATH_INFO: `/v3/projects/6c60874767e8497897d69550d1abc342` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:34.319385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c60874767e8497897d69550d1abc342)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:34.321335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:34.445639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c60874767e8497897d69550d1abc342', 'request_id': 'req-87ec0c93-bcf3-42c7-b013-2501c5863dab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:34.451205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c60874767e8497897d69550d1abc342', 'request_id': 'req-87ec0c93-bcf3-42c7-b013-2501c5863dab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:34.457447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c60874767e8497897d69550d1abc342', 'request_id': 'req-87ec0c93-bcf3-42c7-b013-2501c5863dab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:34.570997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] The token cache is being invalidate because project 6c60874767e8497897d69550d1abc342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:34.571340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:34.572217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-87ec0c93-bcf3-42c7-b013-2501c5863dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:34.578492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 884/1750] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:34 2022] DELETE /identity/v3/projects/6c60874767e8497897d69550d1abc342 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:34.580576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:34.581074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:34.581177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:34.604958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:34.606199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:34.667176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 867/1751] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:34.675462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afa4e0-3a42-4c52-8f75-3ee3c3780c53 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:34.675953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afa4e0-3a42-4c52-8f75-3ee3c3780c53 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:34.676223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afa4e0-3a42-4c52-8f75-3ee3c3780c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:34.695610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:34.695610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:34.697621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-69afa4e0-3a42-4c52-8f75-3ee3c3780c53 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:34.698857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-69afa4e0-3a42-4c52-8f75-3ee3c3780c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:34.707772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 885/1752] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:34.709497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db0a0e-2a14-47bc-a4f4-4dda721443df None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:34.711934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afa4e0-3a42-4c52-8f75-3ee3c3780c53 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:34.714214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:34.714863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:34.715136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:34.715403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] PATH_INFO: `/v3/users/3eec7ecb00e24f4ba98a07ed65f5e89f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:34.716546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eec7ecb00e24f4ba98a07ed65f5e89f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:34.718540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:34.721161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afa4e0-3a42-4c52-8f75-3ee3c3780c53 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:34.726366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:34.726953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:34.727230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:34.727884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:34.728818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:34.729125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:34.741522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:34.742362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 886/1753] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:34.746506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:34.755866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587a19d-021f-4470-bba4-7f79e95c3daf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:34.760480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:34.760997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:34.761273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:34.761542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:34.762147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:34.764002 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:34.906187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:34.913200 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 887/1754] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:34 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:34.917580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:34.991775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b5dff-e334-41d2-a308-104f8f51a44d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:34.996694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:34.997348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:34.997577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:34.997851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:34.998553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.000706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.039774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eec7ecb00e24f4ba98a07ed65f5e89f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.040328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eec7ecb00e24f4ba98a07ed65f5e89f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.061979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eec7ecb00e24f4ba98a07ed65f5e89f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.068155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eec7ecb00e24f4ba98a07ed65f5e89f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.109274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 888/1755] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:34 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:35.113228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.114867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.127653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540559-54d5-476a-874b-ca28b1e5010c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:35.132916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:35.133515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.133790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.134087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.134724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.136305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.146882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 889/1756] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:35.150732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.160391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8445fa-73ac-4dea-a415-fc7e19b46c66 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:35.165151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:35.169857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.169857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.169857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.169857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.169857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.179067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 890/1757] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:35.182931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.192594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123bd7-a67e-420b-babd-2d3cdad4c4b1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:35.197440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b51e9-f1da-496c-80d4-63f2d69e835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:35.199651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1c0e0c6-ae35-412f-9737-cdd5df03068d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eec7ecb00e24f4ba98a07ed65f5e89f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:35.199776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b51e9-f1da-496c-80d4-63f2d69e835c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.199776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b51e9-f1da-496c-80d4-63f2d69e835c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.199776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b51e9-f1da-496c-80d4-63f2d69e835c admin admin] PATH_INFO: `/v3/projects/fdde136245bd48c08afe1c83d5082775/users/d3eb5938ddf347788823ff5a57f81523/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.205655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 868/1758] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:34 2022] DELETE /identity/v3/users/3eec7ecb00e24f4ba98a07ed65f5e89f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:35.210539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.210897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.211272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.216952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b51e9-f1da-496c-80d4-63f2d69e835c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdde136245bd48c08afe1c83d5082775, user_id=d3eb5938ddf347788823ff5a57f81523, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.219686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b51e9-f1da-496c-80d4-63f2d69e835c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.230341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:35.231530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.299417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 869/1759] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:35.309238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.311069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.311907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 891/1760] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:35 2022] PUT /identity/v3/projects/fdde136245bd48c08afe1c83d5082775/users/d3eb5938ddf347788823ff5a57f81523/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:35.322258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.322549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.322820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.327906 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:35.354122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] MFA Rules not processed for user `d3eb5938ddf347788823ff5a57f81523`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:35.355738 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.369060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920d0e5-5f92-495d-b092-42ae6411d959 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:35.425957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:35.426882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.427303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.432662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.434928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 892/1761] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:35.453442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.457618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:35.500614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.502579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.513999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 870/1762] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:35.541748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1208a-c5a2-4e2a-b479-133ad229f9ef None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:35.548677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:35.549291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:35.549619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:35.550510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:35.559642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:35.561284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:35.571648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 893/1763] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:35.973675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:35.976631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:36.000553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f541cf-bbea-4243-ac2c-3015f089e629 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:36.006196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:36.007314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:36.007706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:36.008082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] PATH_INFO: `/v3/projects/ebf9a6d2fc3e4be79017d01f0fea5e04` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:36.009419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf9a6d2fc3e4be79017d01f0fea5e04)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:36.012126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:36.158805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf9a6d2fc3e4be79017d01f0fea5e04', 'request_id': 'req-8d222737-90e3-4173-af22-2b89d2bc0149'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.165784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf9a6d2fc3e4be79017d01f0fea5e04', 'request_id': 'req-8d222737-90e3-4173-af22-2b89d2bc0149'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.171393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf9a6d2fc3e4be79017d01f0fea5e04', 'request_id': 'req-8d222737-90e3-4173-af22-2b89d2bc0149'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.314463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] The token cache is being invalidate because project ebf9a6d2fc3e4be79017d01f0fea5e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:36.314866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.316331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.318339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 871/1764] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:35 2022] DELETE /identity/v3/projects/ebf9a6d2fc3e4be79017d01f0fea5e04 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:36.322199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:36.333856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3ee8f-5551-4b0f-94f5-f0ea8cebc541 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:36.395793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:36.396663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:36.397026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:36.397367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] PATH_INFO: `/v3/users/691c531002d44406a60afbdff849431d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:36.398589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691c531002d44406a60afbdff849431d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:36.400725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:36.676611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691c531002d44406a60afbdff849431d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.683746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691c531002d44406a60afbdff849431d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.684416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691c531002d44406a60afbdff849431d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.685043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691c531002d44406a60afbdff849431d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.692555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:36.774320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691c531002d44406a60afbdff849431d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:36.793283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 894/1765] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:36 2022] DELETE /identity/v3/users/691c531002d44406a60afbdff849431d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:37.293115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:37.293115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:37.306281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d222737-90e3-4173-af22-2b89d2bc0149 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:37.383099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:37.383880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:37.384157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:37.384456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] PATH_INFO: `/v3/projects/9acc22cd60ae4580b1ddbe9ecaebb2d5` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:37.385577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9acc22cd60ae4580b1ddbe9ecaebb2d5)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:37.387632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:37.554698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:37.571308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9acc22cd60ae4580b1ddbe9ecaebb2d5', 'request_id': 'req-0cd341d4-32e3-4f42-848a-5b90553226ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.577617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9acc22cd60ae4580b1ddbe9ecaebb2d5', 'request_id': 'req-0cd341d4-32e3-4f42-848a-5b90553226ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.583130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9acc22cd60ae4580b1ddbe9ecaebb2d5', 'request_id': 'req-0cd341d4-32e3-4f42-848a-5b90553226ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.726036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] The token cache is being invalidate because project 9acc22cd60ae4580b1ddbe9ecaebb2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:37.726329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.726951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:37.728522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 872/1766] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:37 2022] DELETE /identity/v3/projects/9acc22cd60ae4580b1ddbe9ecaebb2d5 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:37.732574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:37.734043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:37.746575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd94e2-0168-4909-a8eb-5230065dc364 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:37.803687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:37.804342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:37.804664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:37.804938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] PATH_INFO: `/v3/users/fff971ffdcb34d38a1315181ad964691` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:37.806038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff971ffdcb34d38a1315181ad964691)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:37.808015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:37.833077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:38.013953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff971ffdcb34d38a1315181ad964691'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.021431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff971ffdcb34d38a1315181ad964691'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.022071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff971ffdcb34d38a1315181ad964691'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.022659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff971ffdcb34d38a1315181ad964691'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.089092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8ba3909c-7fb2-4430-a921-592930718d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff971ffdcb34d38a1315181ad964691'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.108458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 895/1767] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:37 2022] DELETE /identity/v3/users/fff971ffdcb34d38a1315181ad964691 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:38.568638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:38.570309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:38.584207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd341d4-32e3-4f42-848a-5b90553226ed admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:38.660254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:38.660910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:38.661189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:38.661489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] PATH_INFO: `/v3/projects/171cf225f3a347fca9fe31be0afc74da` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:38.662728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=171cf225f3a347fca9fe31be0afc74da)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:38.673218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:38.834542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '171cf225f3a347fca9fe31be0afc74da', 'request_id': 'req-e600222b-0426-44c7-943e-5abd39e7a906'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.840811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '171cf225f3a347fca9fe31be0afc74da', 'request_id': 'req-e600222b-0426-44c7-943e-5abd39e7a906'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.850366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '171cf225f3a347fca9fe31be0afc74da', 'request_id': 'req-e600222b-0426-44c7-943e-5abd39e7a906'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.960047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] The token cache is being invalidate because project 171cf225f3a347fca9fe31be0afc74da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:38.960338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.961108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e600222b-0426-44c7-943e-5abd39e7a906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:38.964868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 873/1768] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:38 2022] DELETE /identity/v3/projects/171cf225f3a347fca9fe31be0afc74da => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:38.968394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083dad3-2087-4c0d-be7d-3c3e94cef578 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:38.968883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083dad3-2087-4c0d-be7d-3c3e94cef578 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:38.968975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083dad3-2087-4c0d-be7d-3c3e94cef578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:38.989693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8083dad3-2087-4c0d-be7d-3c3e94cef578 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:38.990911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8083dad3-2087-4c0d-be7d-3c3e94cef578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:39.065845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 896/1769] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:39.073489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fb0d-8133-4e4e-a90e-909430744263 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.073778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fb0d-8133-4e4e-a90e-909430744263 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.074057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fb0d-8133-4e4e-a90e-909430744263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.094088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-22b0fb0d-8133-4e4e-a90e-909430744263 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:39.095303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-22b0fb0d-8133-4e4e-a90e-909430744263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:39.105485 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 874/1770] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:39.109724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083dad3-2087-4c0d-be7d-3c3e94cef578 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.120659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083dad3-2087-4c0d-be7d-3c3e94cef578 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.126503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.127121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.127391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.127696 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.128380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:39.128709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.130355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.142344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 897/1771] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:39.146873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fb0d-8133-4e4e-a90e-909430744263 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.156973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fb0d-8133-4e4e-a90e-909430744263 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.162396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.163009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.163285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.163642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.164275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.166203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.327503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 875/1772] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:39 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:39.332233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.342530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a279-f71d-4744-9e11-0e121f123cfc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.417650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.418453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.419010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.419292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.419938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.421987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.552694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 898/1773] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:39 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:39.556613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.566834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32da78-3a3d-4103-bbad-c8998d79e864 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.571599 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.572562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.572562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.572822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.573410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.575014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.585327 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 876/1774] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:39.589323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.600562 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a253421-b54f-4a21-8b1c-030c19713218 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.605478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347201-7323-48a3-a899-99670e791464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.605707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347201-7323-48a3-a899-99670e791464 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.605979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347201-7323-48a3-a899-99670e791464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.606246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347201-7323-48a3-a899-99670e791464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.606871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36347201-7323-48a3-a899-99670e791464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.608551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36347201-7323-48a3-a899-99670e791464 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.618983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 899/1775] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:39.623066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.633490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1cabc-3291-4672-a30a-9debb3b93270 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.638108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.638767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.639046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.639319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] PATH_INFO: `/v3/projects/603211f8f6d046ef8a0e8a50e1b2421a/users/3d4939a139b8495bb51181567993339a/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.656686 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603211f8f6d046ef8a0e8a50e1b2421a, user_id=3d4939a139b8495bb51181567993339a, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.659708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.666231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:39.720758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 877/1776] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:39 2022] PUT /identity/v3/projects/603211f8f6d046ef8a0e8a50e1b2421a/users/3d4939a139b8495bb51181567993339a/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:39.731130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.731479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.731813 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.764709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] MFA Rules not processed for user `3d4939a139b8495bb51181567993339a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:39.764709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:39.848236 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 900/1777] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:39.859230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:39.860926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:39.949528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5ee8-c9cf-4dec-a32b-f66c3ca28a39 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:39.953227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b66d3-0ef9-4180-927c-8e2868eaf45f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:39.953835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b66d3-0ef9-4180-927c-8e2868eaf45f service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:39.954118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b66d3-0ef9-4180-927c-8e2868eaf45f service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:39.954389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b66d3-0ef9-4180-927c-8e2868eaf45f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:39.963562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b66d3-0ef9-4180-927c-8e2868eaf45f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:39.965174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b66d3-0ef9-4180-927c-8e2868eaf45f service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:39.974510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 878/1778] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:40.113990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.115144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:40.189996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941f59-bd9f-4235-9069-7e506a33b139 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.195307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.195933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.196206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.196505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] PATH_INFO: `/v3/users/d3eb5938ddf347788823ff5a57f81523` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.197747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3eb5938ddf347788823ff5a57f81523)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.199745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.357605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:40.482268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3eb5938ddf347788823ff5a57f81523'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:40.490098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3eb5938ddf347788823ff5a57f81523'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:40.490785 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3eb5938ddf347788823ff5a57f81523'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:40.491590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3eb5938ddf347788823ff5a57f81523'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:40.581066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3eb5938ddf347788823ff5a57f81523'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:40.608792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 901/1779] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:40 2022] DELETE /identity/v3/users/d3eb5938ddf347788823ff5a57f81523 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:40.613861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.614380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.614485 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.633383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:40.634575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:40.691948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 879/1780] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:40.701572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:40.703073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:40.758756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b29c9-add7-42dd-924b-a12bea1450fc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:40.762327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9c280-edf7-45a2-bcdf-a505cc5a1174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:40.762925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c280-edf7-45a2-bcdf-a505cc5a1174 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:40.763196 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c280-edf7-45a2-bcdf-a505cc5a1174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:40.763461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9c280-edf7-45a2-bcdf-a505cc5a1174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:40.772706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9c280-edf7-45a2-bcdf-a505cc5a1174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:40.774115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9c280-edf7-45a2-bcdf-a505cc5a1174 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:40.783483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 902/1781] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:41.298387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:41.299988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:41.314900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afae45-03fd-4d7f-ab19-9cbb30fd6913 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:41.319692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:41.320315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:41.320625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:41.320894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] PATH_INFO: `/v3/projects/fdde136245bd48c08afe1c83d5082775` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:41.322012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdde136245bd48c08afe1c83d5082775)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:41.324014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:41.447492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdde136245bd48c08afe1c83d5082775', 'request_id': 'req-cf8f91da-434e-4eae-9c86-654a984bdc42'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:41.453838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdde136245bd48c08afe1c83d5082775', 'request_id': 'req-cf8f91da-434e-4eae-9c86-654a984bdc42'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:41.459782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdde136245bd48c08afe1c83d5082775', 'request_id': 'req-cf8f91da-434e-4eae-9c86-654a984bdc42'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:41.614772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] The token cache is being invalidate because project fdde136245bd48c08afe1c83d5082775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:41.615396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:41.615678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-cf8f91da-434e-4eae-9c86-654a984bdc42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:41.617401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 880/1782] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:41 2022] DELETE /identity/v3/projects/fdde136245bd48c08afe1c83d5082775 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:41.622135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa386e0-d824-40c9-ba97-bfb67ea07d7e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:41.622540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa386e0-d824-40c9-ba97-bfb67ea07d7e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:41.622670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa386e0-d824-40c9-ba97-bfb67ea07d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:41.650436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6fa386e0-d824-40c9-ba97-bfb67ea07d7e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:41.652468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6fa386e0-d824-40c9-ba97-bfb67ea07d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:41.714405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 903/1783] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:41.723330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c23ac-f46b-46ed-b96c-3851c3d31a03 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:41.723616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c23ac-f46b-46ed-b96c-3851c3d31a03 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:41.723888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c23ac-f46b-46ed-b96c-3851c3d31a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:41.744021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c26c23ac-f46b-46ed-b96c-3851c3d31a03 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:41.745246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c26c23ac-f46b-46ed-b96c-3851c3d31a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:41.753645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 881/1784] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:41.757725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa386e0-d824-40c9-ba97-bfb67ea07d7e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:41.767292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa386e0-d824-40c9-ba97-bfb67ea07d7e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:41.771872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:41.772491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:41.772774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:41.773046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:41.773690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:41.773990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:41.775581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:41.787330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 904/1785] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:41.791147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c23ac-f46b-46ed-b96c-3851c3d31a03 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:41.800578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c23ac-f46b-46ed-b96c-3851c3d31a03 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:41.805300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:41.805881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:41.806158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:41.806426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:41.807061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:41.808976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:41.930409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 882/1786] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:41 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:41.934402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:41.951842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed005e75-02c0-4208-86d9-05422cff6059 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:42.010263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:42.010903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:42.011518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:42.011851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:42.012762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:42.015784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:42.146712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 905/1787] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:41 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:42.149665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:42.158429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d82c55-0612-4c77-8970-f14404bc892c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:42.163619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:42.164240 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:42.164550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:42.165127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:42.165767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:42.167352 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:42.180547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 883/1788] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:42.184220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:42.195946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40781c1b-219f-44c0-8eac-b226f63eada8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:42.201577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890c3e6-f07e-4f4c-b446-dda8061986d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:42.202188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c3e6-f07e-4f4c-b446-dda8061986d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:42.202436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c3e6-f07e-4f4c-b446-dda8061986d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:42.202707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c3e6-f07e-4f4c-b446-dda8061986d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:42.209381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890c3e6-f07e-4f4c-b446-dda8061986d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:42.209381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890c3e6-f07e-4f4c-b446-dda8061986d7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:42.217048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 906/1789] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:42.227342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:42.241983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb0c8d-b210-4c7c-a6c2-a6fe68042cad admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:42.246583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:42.247229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:42.247504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:42.247775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] PATH_INFO: `/v3/projects/2444d5672f974e1dbe199060113da67e/users/23a9ffef62de430c920c96712899f3f6/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:42.267697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2444d5672f974e1dbe199060113da67e, user_id=23a9ffef62de430c920c96712899f3f6, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:42.267697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:42.395204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 884/1790] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:42 2022] PUT /identity/v3/projects/2444d5672f974e1dbe199060113da67e/users/23a9ffef62de430c920c96712899f3f6/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:42.407229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:42.408701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ff9e-8d28-4916-a542-870395a841ee None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:42.409028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ff9e-8d28-4916-a542-870395a841ee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:42.409300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500ff9e-8d28-4916-a542-870395a841ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:42.456314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b500ff9e-8d28-4916-a542-870395a841ee None None] MFA Rules not processed for user `23a9ffef62de430c920c96712899f3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:42.457587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b500ff9e-8d28-4916-a542-870395a841ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:42.528584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 907/1791] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:42.533306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:42.592504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbccf90-ea73-476c-a7c9-895a9e85e61e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:42.597640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:42.598232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:42.598502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:42.598768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:42.599413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:42.601338 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:42.767868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 885/1792] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:42 2022] POST /identity/v3/projects => generated 405 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:42.775570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500ff9e-8d28-4916-a542-870395a841ee None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:42.787261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500ff9e-8d28-4916-a542-870395a841ee None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:42.844694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731d4ef-8ffe-4406-a55b-6f8d61163e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:42.846855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d4ef-8ffe-4406-a55b-6f8d61163e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:42.846855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d4ef-8ffe-4406-a55b-6f8d61163e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:42.846855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731d4ef-8ffe-4406-a55b-6f8d61163e86 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:42.847229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731d4ef-8ffe-4406-a55b-6f8d61163e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:42.849202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731d4ef-8ffe-4406-a55b-6f8d61163e86 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:43.023474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 908/1793] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:42 2022] POST /identity/v3/users => generated 309 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:43.024699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:43.035266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202fa0c-425a-4bbf-8736-445b4fa0bd3e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:43.040183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:43.040904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.041255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.041531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.042207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:43.043825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:43.061037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 886/1794] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:43.062147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:43.062684 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2cc7-55a6-4a2b-be9d-cefbf30fc348 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.063018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2cc7-55a6-4a2b-be9d-cefbf30fc348 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.063234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e2cc7-55a6-4a2b-be9d-cefbf30fc348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.072670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82541832-4231-40d0-bb03-fadc9d4601df admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:43.077511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:43.079837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.079837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.079837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] PATH_INFO: `/v3/projects/40aa20f50da844598a6e839a11ecfaa8/users/b330380075ca4151b82e6d97da1a24d9/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.084586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-297e2cc7-55a6-4a2b-be9d-cefbf30fc348 None None] MFA Rules not processed for user `3d4939a139b8495bb51181567993339a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:43.087017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-297e2cc7-55a6-4a2b-be9d-cefbf30fc348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:43.093833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40aa20f50da844598a6e839a11ecfaa8, user_id=b330380075ca4151b82e6d97da1a24d9, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:43.096569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:43.141325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 909/1795] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:43.231828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 887/1796] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:43 2022] PUT /identity/v3/projects/40aa20f50da844598a6e839a11ecfaa8/users/b330380075ca4151b82e6d97da1a24d9/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:43.237553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2cc7-55a6-4a2b-be9d-cefbf30fc348 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:43.249510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e2cc7-55a6-4a2b-be9d-cefbf30fc348 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:43.336517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8b65e-960e-4798-bd72-d1fe566416c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:43.337140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b65e-960e-4798-bd72-d1fe566416c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.337558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b65e-960e-4798-bd72-d1fe566416c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.337979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8b65e-960e-4798-bd72-d1fe566416c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.338625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8b65e-960e-4798-bd72-d1fe566416c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:43.340255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8b65e-960e-4798-bd72-d1fe566416c7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:43.354180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 910/1797] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:43.357899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:43.369054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:43.369533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7645-0a5f-4846-b2ee-e3933e648a10 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:43.375050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:43.375924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.376199 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.376496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] PATH_INFO: `/v3/projects/40aa20f50da844598a6e839a11ecfaa8/users/b330380075ca4151b82e6d97da1a24d9/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.378760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40aa20f50da844598a6e839a11ecfaa8, user_id=b330380075ca4151b82e6d97da1a24d9, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:43.381661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:43.402670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 888/1798] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:43 2022] PUT /identity/v3/projects/40aa20f50da844598a6e839a11ecfaa8/users/b330380075ca4151b82e6d97da1a24d9/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:43.406781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ea5f-b9bd-4692-a61d-e620989bb31d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.407313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ea5f-b9bd-4692-a61d-e620989bb31d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.407597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ea5f-b9bd-4692-a61d-e620989bb31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.448568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f4a2ea5f-b9bd-4692-a61d-e620989bb31d None None] MFA Rules not processed for user `b330380075ca4151b82e6d97da1a24d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:43.450277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f4a2ea5f-b9bd-4692-a61d-e620989bb31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:43.535363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 911/1799] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:43.548055 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:43.550525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:43.610202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5069ba8-52c2-414b-8666-f7e0e4ae8140 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:43.614109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7e227-6d79-4fb9-aad4-ae5950607691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:43.614727 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7e227-6d79-4fb9-aad4-ae5950607691 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.615008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7e227-6d79-4fb9-aad4-ae5950607691 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.615278 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7e227-6d79-4fb9-aad4-ae5950607691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.624831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7e227-6d79-4fb9-aad4-ae5950607691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:43.626388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7e227-6d79-4fb9-aad4-ae5950607691 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:43.636839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 889/1800] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:43 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:43.807374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2ea5f-b9bd-4692-a61d-e620989bb31d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:43.870752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2ea5f-b9bd-4692-a61d-e620989bb31d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:43.875189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:43.875838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:43.876111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:43.876377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] PATH_INFO: `/v3/users/23a9ffef62de430c920c96712899f3f6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:43.878073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a9ffef62de430c920c96712899f3f6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:43.879984 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:44.110517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a9ffef62de430c920c96712899f3f6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:44.133073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a9ffef62de430c920c96712899f3f6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:44.133808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a9ffef62de430c920c96712899f3f6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:44.134416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a9ffef62de430c920c96712899f3f6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:44.333780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a9ffef62de430c920c96712899f3f6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:44.352635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 912/1801] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:43 2022] DELETE /identity/v3/users/23a9ffef62de430c920c96712899f3f6 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:44.357446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:44.358563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:44.358563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:44.378709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:44.379940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:44.442151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 890/1802] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:44.452188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:44.453673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:44.509928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5304e3-2e90-40ce-9af6-a68995a41943 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:44.513519 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:44.514112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:44.514384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:44.514683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:44.524095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:44.525545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:44.535796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 913/1803] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:45.104544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:45.107237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:45.155014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d63129-a51e-4a94-9839-c5f9cab59b4e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:45.160654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:45.161930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:45.162219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:45.163632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] PATH_INFO: `/v3/projects/2444d5672f974e1dbe199060113da67e` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:45.163782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2444d5672f974e1dbe199060113da67e)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:45.165936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:45.335614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2444d5672f974e1dbe199060113da67e', 'request_id': 'req-38bf249e-6759-4991-ad11-34a260b8c16a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.342544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2444d5672f974e1dbe199060113da67e', 'request_id': 'req-38bf249e-6759-4991-ad11-34a260b8c16a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.348930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2444d5672f974e1dbe199060113da67e', 'request_id': 'req-38bf249e-6759-4991-ad11-34a260b8c16a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.445863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] The token cache is being invalidate because project 2444d5672f974e1dbe199060113da67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:45.446434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.446775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.448277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 891/1804] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:45 2022] DELETE /identity/v3/projects/2444d5672f974e1dbe199060113da67e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:45.452310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:45.461974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c5cfc-252a-4350-910e-3da4494f4c0a service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:45.474335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:45.518407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:45.519106 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:45.519451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:45.519727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] PATH_INFO: `/v3/users/b330380075ca4151b82e6d97da1a24d9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:45.520875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b330380075ca4151b82e6d97da1a24d9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:45.522792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:45.841464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b330380075ca4151b82e6d97da1a24d9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.848740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b330380075ca4151b82e6d97da1a24d9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.849388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b330380075ca4151b82e6d97da1a24d9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.849983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b330380075ca4151b82e6d97da1a24d9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.976929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ceed8d50-230c-49f1-abae-5c773b83cf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b330380075ca4151b82e6d97da1a24d9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:45.994992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 914/1805] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:45 2022] DELETE /identity/v3/users/b330380075ca4151b82e6d97da1a24d9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:46.686295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:46.686794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:46.712810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf249e-6759-4991-ad11-34a260b8c16a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:46.769470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:46.770449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:46.770907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:46.771388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] PATH_INFO: `/v3/projects/40aa20f50da844598a6e839a11ecfaa8` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:46.772802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40aa20f50da844598a6e839a11ecfaa8)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:46.774710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:46.811566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:46.905566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40aa20f50da844598a6e839a11ecfaa8', 'request_id': 'req-071cbf9f-21a8-41bf-b001-9ae085da93f2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:46.911731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40aa20f50da844598a6e839a11ecfaa8', 'request_id': 'req-071cbf9f-21a8-41bf-b001-9ae085da93f2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:46.918057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40aa20f50da844598a6e839a11ecfaa8', 'request_id': 'req-071cbf9f-21a8-41bf-b001-9ae085da93f2'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:47.082580 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] The token cache is being invalidate because project 40aa20f50da844598a6e839a11ecfaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:47.083241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:47.084190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-071cbf9f-21a8-41bf-b001-9ae085da93f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:47.085893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 892/1806] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:46 2022] DELETE /identity/v3/projects/40aa20f50da844598a6e839a11ecfaa8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:47.090946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f341d2-ac72-4b74-957d-99ad85d918ba None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.091451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f341d2-ac72-4b74-957d-99ad85d918ba None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.091725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f341d2-ac72-4b74-957d-99ad85d918ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.113310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f0f341d2-ac72-4b74-957d-99ad85d918ba None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:47.114511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f0f341d2-ac72-4b74-957d-99ad85d918ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:47.175943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 915/1807] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:47.183819 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba6c1-2ee4-438a-9962-c6b318f61a73 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.184188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba6c1-2ee4-438a-9962-c6b318f61a73 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.184491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ba6c1-2ee4-438a-9962-c6b318f61a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.207040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-678ba6c1-2ee4-438a-9962-c6b318f61a73 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:47.208255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-678ba6c1-2ee4-438a-9962-c6b318f61a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:47.216933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 893/1808] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:47.222046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f341d2-ac72-4b74-957d-99ad85d918ba None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:47.232170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f341d2-ac72-4b74-957d-99ad85d918ba None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:47.237317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:47.238051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.238162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.238438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.239084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:47.239381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:47.241011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:47.252971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 916/1809] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:47.257736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ba6c1-2ee4-438a-9962-c6b318f61a73 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:47.266950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ba6c1-2ee4-438a-9962-c6b318f61a73 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:47.271643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:47.272329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.272759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.273230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.274334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:47.277564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:47.486867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 894/1810] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:47 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:47.491105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:47.501248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed58b-9131-4cc6-b8d8-fc07d5d28caa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:47.587619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:47.588409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.588999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.590012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.590705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:47.593661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:47.775557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 917/1811] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:47 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:47.780264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:47.797276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e36d7-b5e7-479e-885d-af3b5eaeca98 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:47.820498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:47.820498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.820498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.820498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.820931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:47.820931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:47.852670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 895/1812] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:47.856741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:47.869128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08438f1-6480-4323-a8f1-7f6de482a626 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:47.875765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3923e2-1e3c-4855-a9e8-9ad44a454b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:47.876388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3923e2-1e3c-4855-a9e8-9ad44a454b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.876701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3923e2-1e3c-4855-a9e8-9ad44a454b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.876971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3923e2-1e3c-4855-a9e8-9ad44a454b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.879086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3923e2-1e3c-4855-a9e8-9ad44a454b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:47.880877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3923e2-1e3c-4855-a9e8-9ad44a454b29 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:47.906498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 918/1813] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:47.910890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:47.926296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b3207-f8b1-47a6-a652-b40b5f497b88 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:47.933038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:47.936933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:47.937290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:47.937833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] PATH_INFO: `/v3/projects/f1f18f87009449638f6d0a6d9bc2738a/users/87ee4938e4f44cd9ba83d57caa147495/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:47.965060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f18f87009449638f6d0a6d9bc2738a, user_id=87ee4938e4f44cd9ba83d57caa147495, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:47.968416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:48.135656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 896/1814] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:47 2022] PUT /identity/v3/projects/f1f18f87009449638f6d0a6d9bc2738a/users/87ee4938e4f44cd9ba83d57caa147495/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:48.146479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615726a-1afa-48db-a878-558117e2ff8a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:48.146843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615726a-1afa-48db-a878-558117e2ff8a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:48.147322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615726a-1afa-48db-a878-558117e2ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:48.174857 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1615726a-1afa-48db-a878-558117e2ff8a None None] MFA Rules not processed for user `87ee4938e4f44cd9ba83d57caa147495`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:48.176052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1615726a-1afa-48db-a878-558117e2ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:48.238987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 919/1815] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:48.243346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:48.302660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe0b5-f1bb-4865-833b-8d3425c02f0f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:48.307244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:48.307838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:48.308113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:48.308375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:48.313628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:48.313628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:48.496933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 897/1816] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:48 2022] POST /identity/v3/projects => generated 381 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:48.499842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615726a-1afa-48db-a878-558117e2ff8a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:48.511210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615726a-1afa-48db-a878-558117e2ff8a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:48.565696 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:48.566288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:48.566556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:48.566821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:48.567448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:48.569403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:48.672267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:48.675134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:48.689163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01c91a-6f8b-48fd-9935-dec79bce2156 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:48.696749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:48.697556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:48.698203 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:48.698778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] PATH_INFO: `/v3/users/a2d360678cfa49ad8299da148c97b714` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:48.701088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d360678cfa49ad8299da148c97b714)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:48.708096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:48.715780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 920/1817] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:48 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:48.721260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:48.746225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4479b0-d47c-4fd9-be79-f12dd1244cf2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:48.754661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:48.755601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:48.756091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:48.756612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:48.757778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:48.761094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:48.781172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 921/1818] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:48.786171 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:48.808122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680080-e30c-4906-87a7-64862121cf31 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:48.816717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:48.817666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:48.818105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:48.818538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] PATH_INFO: `/v3/projects/b3c479cd367344afa0def4ce96634bf1/users/a0e224d4ba0b4789a468dae590e56511/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:48.842532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c479cd367344afa0def4ce96634bf1, user_id=a0e224d4ba0b4789a468dae590e56511, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:48.849913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:49.000345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 922/1819] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:48 2022] PUT /identity/v3/projects/b3c479cd367344afa0def4ce96634bf1/users/a0e224d4ba0b4789a468dae590e56511/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:49.004276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:49.034052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:49.047325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d360678cfa49ad8299da148c97b714'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.048062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d360678cfa49ad8299da148c97b714'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.060117 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d360678cfa49ad8299da148c97b714'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.066806 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93979357-4f31-4633-beee-848d4b71e64a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:49.067195 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d360678cfa49ad8299da148c97b714'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.071480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:49.072135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.072410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.072718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.073382 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:49.074975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:49.085370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 923/1820] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:42:49.089331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:49.091064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.103880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12305f68-d17f-406d-bc5e-90a12e79de1b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:49.108365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58a9a-9833-4080-866e-bf1444be3692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:49.109012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58a9a-9833-4080-866e-bf1444be3692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.109330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58a9a-9833-4080-866e-bf1444be3692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.109601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58a9a-9833-4080-866e-bf1444be3692 admin admin] PATH_INFO: `/v3/projects/b3c479cd367344afa0def4ce96634bf1/users/a0e224d4ba0b4789a468dae590e56511/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.111529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58a9a-9833-4080-866e-bf1444be3692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c479cd367344afa0def4ce96634bf1, user_id=a0e224d4ba0b4789a468dae590e56511, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:49.114177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58a9a-9833-4080-866e-bf1444be3692 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:49.124334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 924/1821] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:49 2022] PUT /identity/v3/projects/b3c479cd367344afa0def4ce96634bf1/users/a0e224d4ba0b4789a468dae590e56511/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:49.135364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.141496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.141496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.162277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b786e8c8-81d1-4bed-816a-c321d9364e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d360678cfa49ad8299da148c97b714'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:49.164980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] MFA Rules not processed for user `a0e224d4ba0b4789a468dae590e56511`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:49.166209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.175763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 898/1822] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:48 2022] DELETE /identity/v3/users/a2d360678cfa49ad8299da148c97b714 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:49.175763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.175763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.175763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.192132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:49.193331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.234085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 925/1823] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:49.246006 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:49.247331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.252818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 899/1824] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:49.268242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:49.268242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.303579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b00dbf-963b-49ca-9f25-cd5bcf86d54d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:49.307266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:49.307876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.308153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.308422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.317502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:49.318930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:49.320699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499210-ba5b-4a92-8340-b6c582e32483 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:49.324257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:49.324877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.325151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.325413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.328355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 926/1825] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:49.334819 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:49.336233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:49.345634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 900/1826] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:42:49.465625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:49.585229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:49.593449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f5914-dcad-4ed8-ab66-b9b4b404e676 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:49.597055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:49.597645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.597919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.598183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.599880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.658165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:49.659635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:49.668474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 927/1827] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:49.829231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:49.829231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:49.842639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a729-8b3c-48a1-ba98-7c810cda71f1 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:49.867996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:49.879728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:49.879728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:49.879728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] PATH_INFO: `/v3/projects/07322de7bf454c0c91e6d8780617be53` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:49.879728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07322de7bf454c0c91e6d8780617be53)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:49.879728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:50.041600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07322de7bf454c0c91e6d8780617be53', 'request_id': 'req-3502d565-8ecb-4f07-929f-a00f218379b4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.048355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07322de7bf454c0c91e6d8780617be53', 'request_id': 'req-3502d565-8ecb-4f07-929f-a00f218379b4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.055573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07322de7bf454c0c91e6d8780617be53', 'request_id': 'req-3502d565-8ecb-4f07-929f-a00f218379b4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.259546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] The token cache is being invalidate because project 07322de7bf454c0c91e6d8780617be53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:50.259831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.260471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.262045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 901/1828] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:49 2022] DELETE /identity/v3/projects/07322de7bf454c0c91e6d8780617be53 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:50.266088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:50.276773 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc5477-4b9d-4fa4-b6a0-4504eab822ae service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:50.332115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:50.332765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:50.333044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:50.333316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] PATH_INFO: `/v3/users/5863277b18554495ba43b678a4d72fa3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:50.334422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5863277b18554495ba43b678a4d72fa3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:50.336397 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:50.722269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5863277b18554495ba43b678a4d72fa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.729151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5863277b18554495ba43b678a4d72fa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.734237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5863277b18554495ba43b678a4d72fa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.734237 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5863277b18554495ba43b678a4d72fa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.921296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fa844e9a-5721-4cc4-842e-350215d914fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5863277b18554495ba43b678a4d72fa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:50.939929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 928/1829] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:50 2022] DELETE /identity/v3/users/5863277b18554495ba43b678a4d72fa3 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:51.538966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:51.541984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:51.573646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d565-8ecb-4f07-929f-a00f218379b4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:51.649924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:51.650638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:51.650980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:51.651339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] PATH_INFO: `/v3/projects/86a22f408379404883b9d53fe987e1b3` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:51.652628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a22f408379404883b9d53fe987e1b3)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:51.654983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:51.678971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:51.828159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a22f408379404883b9d53fe987e1b3', 'request_id': 'req-5ba5b7be-82cf-439c-bdc0-47e994e76721'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.834379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a22f408379404883b9d53fe987e1b3', 'request_id': 'req-5ba5b7be-82cf-439c-bdc0-47e994e76721'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.839770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a22f408379404883b9d53fe987e1b3', 'request_id': 'req-5ba5b7be-82cf-439c-bdc0-47e994e76721'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.960829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] The token cache is being invalidate because project 86a22f408379404883b9d53fe987e1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:51.961121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.961762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5ba5b7be-82cf-439c-bdc0-47e994e76721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:51.963271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 902/1830] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:51 2022] DELETE /identity/v3/projects/86a22f408379404883b9d53fe987e1b3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:51.968242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8df95-caed-47c8-9cc2-f190fcd163d4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:51.968754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8df95-caed-47c8-9cc2-f190fcd163d4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:51.968987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8df95-caed-47c8-9cc2-f190fcd163d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:51.993156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-53d8df95-caed-47c8-9cc2-f190fcd163d4 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:51.994438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-53d8df95-caed-47c8-9cc2-f190fcd163d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:52.058266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 929/1831] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:52.066403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be891b4-0a7b-4b69-bd63-5696c27f366c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.066687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be891b4-0a7b-4b69-bd63-5696c27f366c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.067052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be891b4-0a7b-4b69-bd63-5696c27f366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.103167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3be891b4-0a7b-4b69-bd63-5696c27f366c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:52.115835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3be891b4-0a7b-4b69-bd63-5696c27f366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:52.115835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 903/1832] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:52.121690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8df95-caed-47c8-9cc2-f190fcd163d4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.137639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8df95-caed-47c8-9cc2-f190fcd163d4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.143079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.143689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.143968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.144238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.144949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:52.145248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.146871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.159590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 930/1833] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:42:52.164040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be891b4-0a7b-4b69-bd63-5696c27f366c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.173635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be891b4-0a7b-4b69-bd63-5696c27f366c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.182042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.182672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.182951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.183219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.183874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.185889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.356725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:52.363568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 904/1834] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:52 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:52.368088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.381637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071626ec-9f6f-44c0-8ffa-12eaa914b103 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.442201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.442811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.443092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.443390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.444019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.445970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.602467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 931/1835] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:52 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:52.603160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.606336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ddcad-9a84-47da-8a5d-4a8fd75ff279 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.610946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.611576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.611855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.612122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.612812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.614407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.624848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 905/1836] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:52.629502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.639770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f816f-7c80-4060-8eef-559c1ae22eb3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.645152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d153-1a0a-41af-aa57-3e97a3d4902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.645841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d153-1a0a-41af-aa57-3e97a3d4902b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.646225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d153-1a0a-41af-aa57-3e97a3d4902b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.646521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d153-1a0a-41af-aa57-3e97a3d4902b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.647273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0d153-1a0a-41af-aa57-3e97a3d4902b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.648947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0d153-1a0a-41af-aa57-3e97a3d4902b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.651899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:52.667927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 932/1837] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:52.668381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:52.679723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbbb0a-b049-4485-bfb6-41a0fcb8bb19 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:52.684828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:52.685514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.685787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.686050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] PATH_INFO: `/v3/projects/ab3a8397c963423da9477f2a78b5dad4/users/9ff505ccaa9647309f357ebfe5a297e7/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.708320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3a8397c963423da9477f2a78b5dad4, user_id=9ff505ccaa9647309f357ebfe5a297e7, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:52.711711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:52.858179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 906/1838] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:52 2022] PUT /identity/v3/projects/ab3a8397c963423da9477f2a78b5dad4/users/9ff505ccaa9647309f357ebfe5a297e7/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:52.870421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bfcf-9ccc-4ab7-8439-75dae7d78278 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:52.870706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bfcf-9ccc-4ab7-8439-75dae7d78278 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:52.870975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bfcf-9ccc-4ab7-8439-75dae7d78278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:52.900922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1726bfcf-9ccc-4ab7-8439-75dae7d78278 None None] MFA Rules not processed for user `9ff505ccaa9647309f357ebfe5a297e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:52.902196 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1726bfcf-9ccc-4ab7-8439-75dae7d78278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:52.972820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 933/1839] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:52.977269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.040982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2e96c-fc52-44bd-8317-9dc9dd204cc4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.054312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818a5d-91e0-48ca-bffc-606f8d66dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.054946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818a5d-91e0-48ca-bffc-606f8d66dd6e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.055228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818a5d-91e0-48ca-bffc-606f8d66dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.055611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818a5d-91e0-48ca-bffc-606f8d66dd6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.056148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05818a5d-91e0-48ca-bffc-606f8d66dd6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.058709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05818a5d-91e0-48ca-bffc-606f8d66dd6e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:53.200796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 907/1840] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:52 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:53.204582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bfcf-9ccc-4ab7-8439-75dae7d78278 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.215961 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bfcf-9ccc-4ab7-8439-75dae7d78278 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.276282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.279918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.280347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.280513 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.281172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.283679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:53.474492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 934/1841] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:53 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:42:53.477546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.477993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117bff-4380-4766-aae4-69a328c01682 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.478329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117bff-4380-4766-aae4-69a328c01682 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.480031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117bff-4380-4766-aae4-69a328c01682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.495054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea974f65-b40d-46f2-8c2c-dd60d617bd92 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.500314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.501960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cf117bff-4380-4766-aae4-69a328c01682 None None] MFA Rules not processed for user `4d5bd861226244e0a3bd6a7ff5a041f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:53.502074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.502074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.502074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.502404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cf117bff-4380-4766-aae4-69a328c01682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:53.502718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.504725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:53.519557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 935/1842] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:53.520840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.535156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88daa-e7fe-4e54-b1f3-4917141744e8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.541327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.542748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.543376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.543831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] PATH_INFO: `/v3/projects/82edd023b866440586673f9bdc262f68/users/caa14f1963564e26a54eb1db58c581dc/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.566250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82edd023b866440586673f9bdc262f68, user_id=caa14f1963564e26a54eb1db58c581dc, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.588262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:53.588583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 908/1843] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:53.723196 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 936/1844] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:53 2022] PUT /identity/v3/projects/82edd023b866440586673f9bdc262f68/users/caa14f1963564e26a54eb1db58c581dc/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:53.746641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf117bff-4380-4766-aae4-69a328c01682 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.758342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf117bff-4380-4766-aae4-69a328c01682 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.821548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9eaae-0da3-4fc5-8218-5015eb2fd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.822245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9eaae-0da3-4fc5-8218-5015eb2fd2af admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.822617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9eaae-0da3-4fc5-8218-5015eb2fd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.822953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9eaae-0da3-4fc5-8218-5015eb2fd2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.823668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9eaae-0da3-4fc5-8218-5015eb2fd2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.825466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9eaae-0da3-4fc5-8218-5015eb2fd2af admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:53.843585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 909/1845] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:53.847535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:53.860175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa33741-86fd-4cc0-afe1-df2c48a02d7c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:53.883860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:53.884595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.885053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.885332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] PATH_INFO: `/v3/projects/82edd023b866440586673f9bdc262f68/users/caa14f1963564e26a54eb1db58c581dc/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.887300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82edd023b866440586673f9bdc262f68, user_id=caa14f1963564e26a54eb1db58c581dc, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:53.890083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:53.904977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 937/1846] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:53 2022] PUT /identity/v3/projects/82edd023b866440586673f9bdc262f68/users/caa14f1963564e26a54eb1db58c581dc/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:53.916059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ad0a8-4b8a-4457-89c7-6424fd06ddeb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:53.916346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ad0a8-4b8a-4457-89c7-6424fd06ddeb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:53.916642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ad0a8-4b8a-4457-89c7-6424fd06ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:53.952821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dc6ad0a8-4b8a-4457-89c7-6424fd06ddeb None None] MFA Rules not processed for user `caa14f1963564e26a54eb1db58c581dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:53.954100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dc6ad0a8-4b8a-4457-89c7-6424fd06ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:54.047236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 910/1847] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:54.059573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:54.061607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:54.122663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce32c2-df55-4ec4-89a0-46d7783619a6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:54.127680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84392162-1b14-45b6-b3ad-6ef530bb9058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:54.131907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392162-1b14-45b6-b3ad-6ef530bb9058 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:54.131907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392162-1b14-45b6-b3ad-6ef530bb9058 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:54.131907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392162-1b14-45b6-b3ad-6ef530bb9058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:54.139481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392162-1b14-45b6-b3ad-6ef530bb9058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:54.140965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392162-1b14-45b6-b3ad-6ef530bb9058 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:54.151631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 938/1848] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:55.531603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:55.656919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:55.989097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ad0a8-4b8a-4457-89c7-6424fd06ddeb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:56.051173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ad0a8-4b8a-4457-89c7-6424fd06ddeb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:56.055637 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:56.056260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:56.056566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:56.056841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] PATH_INFO: `/v3/users/9ff505ccaa9647309f357ebfe5a297e7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:56.057956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff505ccaa9647309f357ebfe5a297e7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:56.059876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:56.301847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff505ccaa9647309f357ebfe5a297e7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:56.302452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff505ccaa9647309f357ebfe5a297e7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:56.314565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff505ccaa9647309f357ebfe5a297e7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:56.321708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff505ccaa9647309f357ebfe5a297e7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:56.385268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff505ccaa9647309f357ebfe5a297e7'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:56.391397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 911/1849] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:55 2022] DELETE /identity/v3/users/9ff505ccaa9647309f357ebfe5a297e7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:56.396506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:56.396790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:56.397077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:56.415870 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:56.417159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:56.476361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 939/1850] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:56.486816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:56.488191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:56.544294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3204c-317a-477c-b13d-5a84ad3e92f6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:56.547895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:56.549053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:56.549329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:56.549596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:56.558366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:56.559730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:56.569863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 912/1851] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:42:57.172704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:57.175155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:57.194617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524bdac-9d63-402a-8f0a-e03155914d18 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:57.199760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:57.200392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.200698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.200968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] PATH_INFO: `/v3/projects/ab3a8397c963423da9477f2a78b5dad4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.202688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3a8397c963423da9477f2a78b5dad4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:57.205199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:57.334293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3a8397c963423da9477f2a78b5dad4', 'request_id': 'req-5445fdcb-53f8-410d-8556-48fe74436656'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.339558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3a8397c963423da9477f2a78b5dad4', 'request_id': 'req-5445fdcb-53f8-410d-8556-48fe74436656'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.346373 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3a8397c963423da9477f2a78b5dad4', 'request_id': 'req-5445fdcb-53f8-410d-8556-48fe74436656'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.489248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] The token cache is being invalidate because project ab3a8397c963423da9477f2a78b5dad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:57.489591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.490444 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.495672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 940/1852] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:57 2022] DELETE /identity/v3/projects/ab3a8397c963423da9477f2a78b5dad4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:42:57.499635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:57.511525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde5d1d-e9d6-445a-b847-99dceced490a service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:57.580601 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:57.581232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:57.581509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:57.581779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] PATH_INFO: `/v3/users/caa14f1963564e26a54eb1db58c581dc` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:57.582931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa14f1963564e26a54eb1db58c581dc)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:57.585144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:57.845456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa14f1963564e26a54eb1db58c581dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.846269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa14f1963564e26a54eb1db58c581dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.858447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa14f1963564e26a54eb1db58c581dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.865290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa14f1963564e26a54eb1db58c581dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.979821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ea14dfbf-3853-4fb0-9c51-b56594c3f114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa14f1963564e26a54eb1db58c581dc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:57.987111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 913/1853] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:42:57 2022] DELETE /identity/v3/users/caa14f1963564e26a54eb1db58c581dc => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:58.531377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:58.535344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:58.561721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fdcb-53f8-410d-8556-48fe74436656 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:58.638585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:58.639113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:58.639387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:58.639649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] PATH_INFO: `/v3/projects/82edd023b866440586673f9bdc262f68` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:58.640778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82edd023b866440586673f9bdc262f68)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:58.642705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:58.788048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82edd023b866440586673f9bdc262f68', 'request_id': 'req-02d9575c-9c24-4706-9e71-4f7aa617fe61'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:58.794434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82edd023b866440586673f9bdc262f68', 'request_id': 'req-02d9575c-9c24-4706-9e71-4f7aa617fe61'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:58.801513 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82edd023b866440586673f9bdc262f68', 'request_id': 'req-02d9575c-9c24-4706-9e71-4f7aa617fe61'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:58.999219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] The token cache is being invalidate because project 82edd023b866440586673f9bdc262f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:42:58.999219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:58.999401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-02d9575c-9c24-4706-9e71-4f7aa617fe61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:42:59.000940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 941/1854] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:42:58 2022] DELETE /identity/v3/projects/82edd023b866440586673f9bdc262f68 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:59.006202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305a72-9910-49b0-8ed2-eb48481ad1c4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.006693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305a72-9910-49b0-8ed2-eb48481ad1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.006785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec305a72-9910-49b0-8ed2-eb48481ad1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.029490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ec305a72-9910-49b0-8ed2-eb48481ad1c4 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:59.030696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ec305a72-9910-49b0-8ed2-eb48481ad1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:59.103425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 914/1855] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:59.113916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fb51-9a5b-45e4-9bbc-428e0ba6b9c9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.114080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fb51-9a5b-45e4-9bbc-428e0ba6b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.114558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347fb51-9a5b-45e4-9bbc-428e0ba6b9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.142045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c347fb51-9a5b-45e4-9bbc-428e0ba6b9c9 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:59.152845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c347fb51-9a5b-45e4-9bbc-428e0ba6b9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:59.152845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:59.155679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 942/1856] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:42:59.160036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305a72-9910-49b0-8ed2-eb48481ad1c4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:59.169692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec305a72-9910-49b0-8ed2-eb48481ad1c4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:59.183737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:59.183737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.183737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.183737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.184128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:42:59.184128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:59.184128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:59.192473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 915/1857] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:42:59.195030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fb51-9a5b-45e4-9bbc-428e0ba6b9c9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:59.205292 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347fb51-9a5b-45e4-9bbc-428e0ba6b9c9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:59.210371 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:59.210972 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.212233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.212233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.212424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:59.214315 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:59.347149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 943/1858] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:59 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:59.350991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:59.361050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8e11-0afe-4165-b14d-a11c1d7dc301 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:59.418902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:59.419501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.419775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.420040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.420771 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:59.422672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:59.434333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:42:59.545136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 916/1859] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:42:59 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:42:59.546305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:59.557272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d62d38-f4b9-46f3-850c-5f03b55a097f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:59.562008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:59.562604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.562903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.563167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.563800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:59.566164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:59.576138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 944/1860] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:59.580202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:59.590360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57bce7-df7c-4f33-a555-0cc613f0ed9e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:59.594888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d3f81-d9a2-44fd-8c4d-3ffbe4f7d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:59.595526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d3f81-d9a2-44fd-8c4d-3ffbe4f7d627 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.595915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d3f81-d9a2-44fd-8c4d-3ffbe4f7d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.596229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d3f81-d9a2-44fd-8c4d-3ffbe4f7d627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.596921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d3f81-d9a2-44fd-8c4d-3ffbe4f7d627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:59.598488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d3f81-d9a2-44fd-8c4d-3ffbe4f7d627 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:59.608898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 917/1861] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:42:59.613503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:59.623128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a9fc3-8229-4c93-b533-20b812def8af admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:59.628372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:59.629039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.629319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.629592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] PATH_INFO: `/v3/projects/371ab4477190480381e009b80e328d98/users/7ebdab5436f44c6facba9538f20009f1/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.644507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=371ab4477190480381e009b80e328d98, user_id=7ebdab5436f44c6facba9538f20009f1, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:59.647299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:42:59.734188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 945/1862] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:42:59 2022] PUT /identity/v3/projects/371ab4477190480381e009b80e328d98/users/7ebdab5436f44c6facba9538f20009f1/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:42:59.746048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a5af3-f749-469a-8180-4be0692a1f4b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.746388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a5af3-f749-469a-8180-4be0692a1f4b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.746707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a5af3-f749-469a-8180-4be0692a1f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.776701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c29a5af3-f749-469a-8180-4be0692a1f4b None None] MFA Rules not processed for user `7ebdab5436f44c6facba9538f20009f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:42:59.777941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c29a5af3-f749-469a-8180-4be0692a1f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:42:59.855021 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 918/1863] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:42:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:42:59.859861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:42:59.967948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85831-4e79-4f87-829c-a5200fa84e7a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:42:59.975360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:42:59.976409 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:42:59.976930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:42:59.977370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:42:59.978776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:42:59.981763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:00.071284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 946/1864] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:42:59 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:00.075979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a5af3-f749-469a-8180-4be0692a1f4b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:00.087394 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a5af3-f749-469a-8180-4be0692a1f4b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:00.183119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:00.183730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:00.184010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:00.184329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:00.184997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:00.186927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:00.322830 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 919/1865] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:00 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:00.326763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:00.341018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05249abb-bf05-4ffd-84ca-da3d74017929 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:00.345706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:00.346316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:00.346616 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:00.346891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:00.347534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:00.349309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:00.360289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 947/1866] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:00.365119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:00.382542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77434eaa-82d3-470a-ab8c-a5ead965f475 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:00.388223 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:00.388925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:00.389260 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:00.389537 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] PATH_INFO: `/v3/projects/e6e2326ba97b42259963fc563a1d7e69/users/c62fb3115e134ab885bf7ab0fc31b824/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:00.406459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e2326ba97b42259963fc563a1d7e69, user_id=c62fb3115e134ab885bf7ab0fc31b824, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:00.409407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:00.546627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 920/1867] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:00 2022] PUT /identity/v3/projects/e6e2326ba97b42259963fc563a1d7e69/users/c62fb3115e134ab885bf7ab0fc31b824/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:00.555671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:00.566656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e03da6-6b8d-407a-b3e2-22b11aed7ce5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:00.638194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0cda6-144b-48be-9fb7-7c2a34d870c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:00.638819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0cda6-144b-48be-9fb7-7c2a34d870c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:00.639093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0cda6-144b-48be-9fb7-7c2a34d870c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:00.639357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0cda6-144b-48be-9fb7-7c2a34d870c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:00.640002 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0cda6-144b-48be-9fb7-7c2a34d870c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:00.641614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0cda6-144b-48be-9fb7-7c2a34d870c7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:00.656855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 948/1868] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:00.659389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:00.670507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de8661-fd6a-4063-94e6-bc5e87799c70 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:00.675827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:00.676701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:00.676978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:00.677246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] PATH_INFO: `/v3/projects/e6e2326ba97b42259963fc563a1d7e69/users/c62fb3115e134ab885bf7ab0fc31b824/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:00.679206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e2326ba97b42259963fc563a1d7e69, user_id=c62fb3115e134ab885bf7ab0fc31b824, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:00.681894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:00.692085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 921/1869] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:00 2022] PUT /identity/v3/projects/e6e2326ba97b42259963fc563a1d7e69/users/c62fb3115e134ab885bf7ab0fc31b824/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:00.710049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9e82-ef29-4e53-a43e-d104c6cfbb23 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:00.710327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9e82-ef29-4e53-a43e-d104c6cfbb23 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:00.710593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9e82-ef29-4e53-a43e-d104c6cfbb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:00.740178 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-09ea9e82-ef29-4e53-a43e-d104c6cfbb23 None None] MFA Rules not processed for user `c62fb3115e134ab885bf7ab0fc31b824`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:00.745309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-09ea9e82-ef29-4e53-a43e-d104c6cfbb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:00.818392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 949/1870] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:00.830948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:00.832787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:00.893445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72b13-f18c-40bf-bc0f-8e9d0209f930 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:00.897370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9dc50-ece5-4521-8617-7287585d2f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:00.897971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9dc50-ece5-4521-8617-7287585d2f8a service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:00.898250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9dc50-ece5-4521-8617-7287585d2f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:00.898520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9dc50-ece5-4521-8617-7287585d2f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:00.907940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9dc50-ece5-4521-8617-7287585d2f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:00.909438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9dc50-ece5-4521-8617-7287585d2f8a service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:00.919240 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 922/1871] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:01.639679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:01.888410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:02.687225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9e82-ef29-4e53-a43e-d104c6cfbb23 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:02.771280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9e82-ef29-4e53-a43e-d104c6cfbb23 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:02.779852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:02.780663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:02.786912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:02.786912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] PATH_INFO: `/v3/users/7ebdab5436f44c6facba9538f20009f1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:02.786912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ebdab5436f44c6facba9538f20009f1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:02.786912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:03.065347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ebdab5436f44c6facba9538f20009f1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:03.072380 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ebdab5436f44c6facba9538f20009f1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:03.073168 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ebdab5436f44c6facba9538f20009f1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:03.073864 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ebdab5436f44c6facba9538f20009f1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:03.176183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ebdab5436f44c6facba9538f20009f1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:03.195065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 950/1872] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:02 2022] DELETE /identity/v3/users/7ebdab5436f44c6facba9538f20009f1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:03.199399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:03.199799 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:03.200053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:03.218913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:03.220761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:03.279642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 923/1873] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:03.289951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:03.291417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:03.346931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9f47c-50dc-4a8f-aacd-bdafbb433a75 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:03.350523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:03.351123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:03.351399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:03.351670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:03.360300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:03.361768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:03.370943 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 951/1874] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:03.785250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:03.954195 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:03.956373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:03.967931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977af21b-f31d-41bc-8e45-2b15b642e2fa None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:03.978004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:03.978657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:03.979155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:03.979436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] PATH_INFO: `/v3/projects/371ab4477190480381e009b80e328d98` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:03.980759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] RBAC: Authorizing `identity:delete_project(project_id=371ab4477190480381e009b80e328d98)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:03.982882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:04.137763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371ab4477190480381e009b80e328d98', 'request_id': 'req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.144539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371ab4477190480381e009b80e328d98', 'request_id': 'req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.150335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371ab4477190480381e009b80e328d98', 'request_id': 'req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.315350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] The token cache is being invalidate because project 371ab4477190480381e009b80e328d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:04.315978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.316623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.318141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 924/1875] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:03 2022] DELETE /identity/v3/projects/371ab4477190480381e009b80e328d98 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:04.323053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:04.333121 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba93097-b930-49d6-b9c3-a0fac58641ec service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:04.389689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:04.390343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:04.390611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:04.390886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] PATH_INFO: `/v3/users/c62fb3115e134ab885bf7ab0fc31b824` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:04.392022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62fb3115e134ab885bf7ab0fc31b824)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:04.393993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:04.464828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:04.466701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:04.481142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d4bf6-65f9-4c33-b22d-b39b92d3522e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:04.486510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:04.487141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:04.487421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:04.487692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] PATH_INFO: `/v3/users/87ee4938e4f44cd9ba83d57caa147495` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:04.488889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ee4938e4f44cd9ba83d57caa147495)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:04.490841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:04.665385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62fb3115e134ab885bf7ab0fc31b824'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.672697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62fb3115e134ab885bf7ab0fc31b824'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.673952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62fb3115e134ab885bf7ab0fc31b824'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.674548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62fb3115e134ab885bf7ab0fc31b824'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.842217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c28fb225-c2e5-4824-8790-265c6e8f2c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62fb3115e134ab885bf7ab0fc31b824'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.859668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ee4938e4f44cd9ba83d57caa147495'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.863718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 952/1876] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:04 2022] DELETE /identity/v3/users/c62fb3115e134ab885bf7ab0fc31b824 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:04.866707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ee4938e4f44cd9ba83d57caa147495'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.877221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ee4938e4f44cd9ba83d57caa147495'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:04.884291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ee4938e4f44cd9ba83d57caa147495'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.016631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ee4938e4f44cd9ba83d57caa147495'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.023560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 925/1877] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:04 2022] DELETE /identity/v3/users/87ee4938e4f44cd9ba83d57caa147495 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:05.028171 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.028469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.028748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.048576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:05.049750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.121492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 953/1878] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:05.137183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:05.138574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.216371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe8885-b3ff-4bb9-94f5-271023ab0641 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:05.222447 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa67d56-c921-4351-8ab0-251eaef5e464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:05.222842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa67d56-c921-4351-8ab0-251eaef5e464 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.223186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa67d56-c921-4351-8ab0-251eaef5e464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.223525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa67d56-c921-4351-8ab0-251eaef5e464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.237427 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa67d56-c921-4351-8ab0-251eaef5e464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:05.239059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa67d56-c921-4351-8ab0-251eaef5e464 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:05.250159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 926/1879] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:05.273012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:05.420482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:05.421967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.434714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5bdf7-9561-4141-9c33-38cbb287771e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:05.439847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:05.440487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.440771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.441041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] PATH_INFO: `/v3/projects/e6e2326ba97b42259963fc563a1d7e69` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.442183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e2326ba97b42259963fc563a1d7e69)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:05.444142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:05.582938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e2326ba97b42259963fc563a1d7e69', 'request_id': 'req-19a43864-dde8-43c3-876b-78c0909fa7ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.588442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e2326ba97b42259963fc563a1d7e69', 'request_id': 'req-19a43864-dde8-43c3-876b-78c0909fa7ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.595645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e2326ba97b42259963fc563a1d7e69', 'request_id': 'req-19a43864-dde8-43c3-876b-78c0909fa7ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.679352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] The token cache is being invalidate because project e6e2326ba97b42259963fc563a1d7e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:05.679638 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.680251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19a43864-dde8-43c3-876b-78c0909fa7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.682255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 954/1880] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:05 2022] DELETE /identity/v3/projects/e6e2326ba97b42259963fc563a1d7e69 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:05.686941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.687412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.687700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.707556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:05.708775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.769285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 927/1881] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:05.777265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a4597-11b4-46c1-8d12-98d9aa01127d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.784113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a4597-11b4-46c1-8d12-98d9aa01127d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.784113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a4597-11b4-46c1-8d12-98d9aa01127d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.797128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1e0a4597-11b4-46c1-8d12-98d9aa01127d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:05.798838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1e0a4597-11b4-46c1-8d12-98d9aa01127d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.807270 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 955/1882] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:05.809996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:05.811184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a4597-11b4-46c1-8d12-98d9aa01127d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:05.815408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:05.821501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a4597-11b4-46c1-8d12-98d9aa01127d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:05.825454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b479c-204b-45fb-be0f-2b2242c53609 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:05.826722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:05.827272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.827559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.827825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.828525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:05.828829 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:05.830489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:05.836186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:05.836902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.837186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.837454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] PATH_INFO: `/v3/projects/f1f18f87009449638f6d0a6d9bc2738a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.839493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f18f87009449638f6d0a6d9bc2738a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:05.844558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:05.846596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 956/1883] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:43:05.850744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:05.861644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0cc2f-b794-4a10-b238-e5c5a111af5c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:05.866687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:05.867763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:05.868157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:05.868424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:05.870172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:05.872218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:05.979303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f18f87009449638f6d0a6d9bc2738a', 'request_id': 'req-5104d90a-8b62-41b9-83d0-3799fa5c2371'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.981074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 957/1884] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:05 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:05.986482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:05.986928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f18f87009449638f6d0a6d9bc2738a', 'request_id': 'req-5104d90a-8b62-41b9-83d0-3799fa5c2371'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:05.993687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f18f87009449638f6d0a6d9bc2738a', 'request_id': 'req-5104d90a-8b62-41b9-83d0-3799fa5c2371'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.051596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa2f1-fc40-4475-9957-26b7ef4293b1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.056695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.057300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.057578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.059887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.059887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.060441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.117281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:06.117481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] The token cache is being invalidate because project f1f18f87009449638f6d0a6d9bc2738a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:06.117481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.117481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.118289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 928/1885] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:05 2022] DELETE /identity/v3/projects/f1f18f87009449638f6d0a6d9bc2738a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:06.122210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.123520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.187145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104d90a-8b62-41b9-83d0-3799fa5c2371 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.191808 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.192423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.192732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.193000 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] PATH_INFO: `/v3/users/a0e224d4ba0b4789a468dae590e56511` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.194105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e224d4ba0b4789a468dae590e56511)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.196018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.213902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 958/1886] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:05 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:06.215104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.216710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.229288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01a60e-9328-4729-a841-0c1d2293d167 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.234160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.234776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.237814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.237814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.237814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.238079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.248095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 959/1887] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:06.252087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.261489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac4cc2-0a46-4516-bed1-035cd438c3a2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.266080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.267229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.267507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.267773 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.268374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.269914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.281476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 960/1888] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:06.285842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.295051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd2a46-2597-433d-978a-ce71e39d157c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.299684 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391b51-84be-41f0-b11f-4753549a9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.300788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391b51-84be-41f0-b11f-4753549a9445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.300788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391b51-84be-41f0-b11f-4753549a9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.300949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391b51-84be-41f0-b11f-4753549a9445 admin admin] PATH_INFO: `/v3/projects/188d3869b70641788f364fb663152d3a/users/5f9e7f9c430e4d63af21b6f3aee3dfa3/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.316179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b391b51-84be-41f0-b11f-4753549a9445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188d3869b70641788f364fb663152d3a, user_id=5f9e7f9c430e4d63af21b6f3aee3dfa3, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.318921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b391b51-84be-41f0-b11f-4753549a9445 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.433941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 961/1889] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:06 2022] PUT /identity/v3/projects/188d3869b70641788f364fb663152d3a/users/5f9e7f9c430e4d63af21b6f3aee3dfa3/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:06.445361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.445645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.445912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.479843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] MFA Rules not processed for user `5f9e7f9c430e4d63af21b6f3aee3dfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:06.481156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.503429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e224d4ba0b4789a468dae590e56511'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.504319 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e224d4ba0b4789a468dae590e56511'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.519893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e224d4ba0b4789a468dae590e56511'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.527517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e224d4ba0b4789a468dae590e56511'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.557296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 962/1890] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:06.568163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.569552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.625294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291737f-bd78-40dd-a832-d2d183d8f7ac None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.629348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.629939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.630212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.630478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.638650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.640055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:06.649265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 963/1891] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:06.652191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-629d4c94-d727-45ea-8c71-8a7ca6f12e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e224d4ba0b4789a468dae590e56511'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:06.659528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 929/1892] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:06 2022] DELETE /identity/v3/users/a0e224d4ba0b4789a468dae590e56511 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:06.668675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:06.670060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:06.734224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2bae8-133c-4b4e-8346-81799c9a0e83 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:06.789056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:06.789691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:06.789970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:06.790281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] PATH_INFO: `/v3/users/5f9e7f9c430e4d63af21b6f3aee3dfa3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:06.791448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f9e7f9c430e4d63af21b6f3aee3dfa3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:06.793429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:07.131068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f9e7f9c430e4d63af21b6f3aee3dfa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.140111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f9e7f9c430e4d63af21b6f3aee3dfa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.140960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f9e7f9c430e4d63af21b6f3aee3dfa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.141634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f9e7f9c430e4d63af21b6f3aee3dfa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.285556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f9e7f9c430e4d63af21b6f3aee3dfa3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.310233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 964/1893] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:06 2022] DELETE /identity/v3/users/5f9e7f9c430e4d63af21b6f3aee3dfa3 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:07.315467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.315991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.316180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.335305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:07.336562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:07.395316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 930/1894] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:07.405654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:07.408353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:07.408942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:07.410410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:07.422546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af78f-dae1-45d6-8d48-18f93b5f332d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:07.428391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:07.429049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.429330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.429603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] PATH_INFO: `/v3/projects/b3c479cd367344afa0def4ce96634bf1` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.430982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c479cd367344afa0def4ce96634bf1)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:07.432782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:07.478109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3bab3-4247-4a9d-b562-e71703cbe7d5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:07.482163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9596-628e-4f4f-be70-1f33c79b2444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:07.482794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9596-628e-4f4f-be70-1f33c79b2444 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.483129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9596-628e-4f4f-be70-1f33c79b2444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.483320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9596-628e-4f4f-be70-1f33c79b2444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.493787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9596-628e-4f4f-be70-1f33c79b2444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:07.498064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9596-628e-4f4f-be70-1f33c79b2444 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:07.506863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 965/1895] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:07.624785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c479cd367344afa0def4ce96634bf1', 'request_id': 'req-e58f51ba-fa1d-42ab-8074-c198e1e0920d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.635167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c479cd367344afa0def4ce96634bf1', 'request_id': 'req-e58f51ba-fa1d-42ab-8074-c198e1e0920d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.644236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c479cd367344afa0def4ce96634bf1', 'request_id': 'req-e58f51ba-fa1d-42ab-8074-c198e1e0920d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.742073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] The token cache is being invalidate because project b3c479cd367344afa0def4ce96634bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:07.742358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.743224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e58f51ba-fa1d-42ab-8074-c198e1e0920d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:07.745230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 931/1896] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:07 2022] DELETE /identity/v3/projects/b3c479cd367344afa0def4ce96634bf1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:07.750809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05e7e-594b-43f4-a20c-69c833f41ef5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.751133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05e7e-594b-43f4-a20c-69c833f41ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.751471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c05e7e-594b-43f4-a20c-69c833f41ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.772707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e7c05e7e-594b-43f4-a20c-69c833f41ef5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:07.773960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e7c05e7e-594b-43f4-a20c-69c833f41ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:07.838690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 966/1897] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:07.847533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998b160-e702-4932-9d36-2f58db3b4aa9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.847849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998b160-e702-4932-9d36-2f58db3b4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.848122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998b160-e702-4932-9d36-2f58db3b4aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.868112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3998b160-e702-4932-9d36-2f58db3b4aa9 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:07.869350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3998b160-e702-4932-9d36-2f58db3b4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:07.877639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 932/1898] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:07.881985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05e7e-594b-43f4-a20c-69c833f41ef5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:07.892582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c05e7e-594b-43f4-a20c-69c833f41ef5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:07.897232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:07.897824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.898097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.898364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.899000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:07.899295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:07.900951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:07.905901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:07.919260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 967/1899] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:07.920663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998b160-e702-4932-9d36-2f58db3b4aa9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:07.929867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998b160-e702-4932-9d36-2f58db3b4aa9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:07.934554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:07.935174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:07.935452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:07.935721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:07.936350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:07.938289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.003742 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.005572 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.021636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4109-3bf3-40e6-9204-20017f38a212 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.028327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.040141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.040141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.040141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] PATH_INFO: `/v3/projects/188d3869b70641788f364fb663152d3a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.040141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188d3869b70641788f364fb663152d3a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.040141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.041005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 933/1900] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:07 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:08.042933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.150012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19267e-c684-4a45-90f1-f6c9bb4dd045 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.155087 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.155685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.155963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.156233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.156893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.158837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.194392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188d3869b70641788f364fb663152d3a', 'request_id': 'req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.200632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188d3869b70641788f364fb663152d3a', 'request_id': 'req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.209622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188d3869b70641788f364fb663152d3a', 'request_id': 'req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.274724 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 934/1901] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:08 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:08.274724 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.274724 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.286609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dd024-e762-4e08-86fb-e6c299b221f6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.341439 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.342072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.342379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.342859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] PATH_INFO: `/v3/users/dc3576435d474a888e33963003d2d426` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.343993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3576435d474a888e33963003d2d426)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.346044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.346807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] The token cache is being invalidate because project 188d3869b70641788f364fb663152d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:08.348953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.348953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.349281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 968/1902] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:08 2022] DELETE /identity/v3/projects/188d3869b70641788f364fb663152d3a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:08.352597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.352597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.364068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016e168-0c2b-4304-a4e6-e1bf2f9b1705 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.369101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008039d0-0c0c-409f-8c37-c21b8237c71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.369698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008039d0-0c0c-409f-8c37-c21b8237c71f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.369988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008039d0-0c0c-409f-8c37-c21b8237c71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.370245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008039d0-0c0c-409f-8c37-c21b8237c71f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.370887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008039d0-0c0c-409f-8c37-c21b8237c71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.372610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008039d0-0c0c-409f-8c37-c21b8237c71f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.387959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 969/1903] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:08.387959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758d1b4-c2db-4490-bd3e-79a018c17db2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.387959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758d1b4-c2db-4490-bd3e-79a018c17db2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.387959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758d1b4-c2db-4490-bd3e-79a018c17db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.408022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9758d1b4-c2db-4490-bd3e-79a018c17db2 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:08.409247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9758d1b4-c2db-4490-bd3e-79a018c17db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.417512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 970/1904] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:08.418405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758d1b4-c2db-4490-bd3e-79a018c17db2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.428148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758d1b4-c2db-4490-bd3e-79a018c17db2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.432781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3330ec-c7c7-4356-aad8-09f996f466de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.433435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3330ec-c7c7-4356-aad8-09f996f466de admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.433717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3330ec-c7c7-4356-aad8-09f996f466de admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.433981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3330ec-c7c7-4356-aad8-09f996f466de admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.434619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3330ec-c7c7-4356-aad8-09f996f466de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.436205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3330ec-c7c7-4356-aad8-09f996f466de admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.447372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 971/1905] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:08.451770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424d69-029e-4921-be84-c7fb1a1d6d09 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.452051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424d69-029e-4921-be84-c7fb1a1d6d09 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.452324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424d69-029e-4921-be84-c7fb1a1d6d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.471836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-35424d69-029e-4921-be84-c7fb1a1d6d09 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:08.473571 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-35424d69-029e-4921-be84-c7fb1a1d6d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.480914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 972/1906] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:08.484796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424d69-029e-4921-be84-c7fb1a1d6d09 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.495419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424d69-029e-4921-be84-c7fb1a1d6d09 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.500343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.501686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.501960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.502231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] PATH_INFO: `/v3/projects/98adfe003ac24253894a6e59459cf6c3/users/9df5760263f3479bb4a95acf3ab3ee31/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.516737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=98adfe003ac24253894a6e59459cf6c3, user_id=9df5760263f3479bb4a95acf3ab3ee31, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.519388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.641898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3576435d474a888e33963003d2d426'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.642695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3576435d474a888e33963003d2d426'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.647553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 973/1907] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:08 2022] PUT /identity/v3/projects/98adfe003ac24253894a6e59459cf6c3/users/9df5760263f3479bb4a95acf3ab3ee31/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:08.648540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.650138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.664372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3576435d474a888e33963003d2d426'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.671331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3576435d474a888e33963003d2d426'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.713620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37015e93-3b1c-4f00-aa0e-9e9389d23bde admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.718493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbe786-c5d4-4f2d-b9d6-3006bc3b0037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.719092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbe786-c5d4-4f2d-b9d6-3006bc3b0037 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.719365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbe786-c5d4-4f2d-b9d6-3006bc3b0037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.719657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbe786-c5d4-4f2d-b9d6-3006bc3b0037 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.720296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbe786-c5d4-4f2d-b9d6-3006bc3b0037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:08.720631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbe786-c5d4-4f2d-b9d6-3006bc3b0037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.722209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbe786-c5d4-4f2d-b9d6-3006bc3b0037 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.734897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 974/1908] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:08.736732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369c163-2e9e-4d13-9d66-eeb7981bc6e3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.737013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369c163-2e9e-4d13-9d66-eeb7981bc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.737282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369c163-2e9e-4d13-9d66-eeb7981bc6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.764912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3576435d474a888e33963003d2d426'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:08.767752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b369c163-2e9e-4d13-9d66-eeb7981bc6e3 None None] MFA Rules not processed for user `9df5760263f3479bb4a95acf3ab3ee31`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:08.769407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b369c163-2e9e-4d13-9d66-eeb7981bc6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.777135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 935/1909] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:08 2022] DELETE /identity/v3/users/dc3576435d474a888e33963003d2d426 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:08.778322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.852798 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 975/1910] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:08.854448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.854788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.855060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.863734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd53aa-779a-4943-b1e0-dc37edd74b78 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.871771 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.872387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.872698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.873681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.873926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.875781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.889672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:08.891070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.905578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 976/1911] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:08.906393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.908254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:08.921168 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa3013-f990-4ab0-9cba-ddbf8dcd9aad None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:08.926447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:08.927054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:08.927332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:08.927603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:08.928240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:08.930290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:08.972464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 936/1912] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:08 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:08.973367 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:08.974974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:09.032584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c262-d58e-41de-9baa-eace281e87a4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.036619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.038413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:09.038877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.039201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.039475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.100668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 977/1913] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:08 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:09.101752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.102623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.104108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.114233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 937/1914] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:09.115086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.130562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1eaa-efc9-46fa-8988-2075baee7abc service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.175564 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d884aa2-d77d-44f4-9115-f7cf796c93c7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.180874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.181517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.181799 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.182065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.182838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.184807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.195647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.196607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.196974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.203514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.203514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.203514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.296639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 978/1915] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:09 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:09.298540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 938/1916] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:09 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:09.302241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.302401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.313096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7b81-f708-4f68-b8d2-db0cb117f5ed admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.314099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789be57-6a18-47bd-bc27-4bec406a87f1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.318399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.318712 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.319140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.319300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.319551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.319648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.319824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.320001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.320552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.321073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.322143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.323069 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.333403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 979/1917] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:09.333575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 939/1918] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:09.337336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.337565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.347002 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283005d-6581-48dd-b496-18db7c87130b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.347620 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482ba32-9e6d-41b7-afb7-d5fac740106c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.351820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.352414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.352700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.352819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.353028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.354013 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.354131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.354233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.354233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] PATH_INFO: `/v3/projects/4a39b978d01c45f89f0945632d855aa2/users/4ae027cec67e40eeae1f607ebfc95c98/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.355400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.374203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 980/1919] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:09.374554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a39b978d01c45f89f0945632d855aa2, user_id=4ae027cec67e40eeae1f607ebfc95c98, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.374554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.379459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.389981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1677b-f88d-498d-94fc-7b88fbfef0fc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.395352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bb22f-0c88-4731-912d-853e126ad6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.396003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb22f-0c88-4731-912d-853e126ad6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.396283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb22f-0c88-4731-912d-853e126ad6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.396584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb22f-0c88-4731-912d-853e126ad6cb admin admin] PATH_INFO: `/v3/projects/67fcea3fc2a340959d1297ec1b99d23a/users/0edc147c80a943f3838845598a4d28b1/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.413491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bb22f-0c88-4731-912d-853e126ad6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fcea3fc2a340959d1297ec1b99d23a, user_id=0edc147c80a943f3838845598a4d28b1, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.416417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bb22f-0c88-4731-912d-853e126ad6cb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.494843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 940/1920] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:09 2022] PUT /identity/v3/projects/4a39b978d01c45f89f0945632d855aa2/users/4ae027cec67e40eeae1f607ebfc95c98/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:09.498579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.523071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 981/1921] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:09 2022] PUT /identity/v3/projects/67fcea3fc2a340959d1297ec1b99d23a/users/0edc147c80a943f3838845598a4d28b1/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:09.535527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.535894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.536235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.582249 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] MFA Rules not processed for user `0edc147c80a943f3838845598a4d28b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:09.584058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:09.597060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72171ea7-87b9-4e0f-8749-d27af77b5c05 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.662176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 982/1922] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:09.668677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.669420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.670097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.670425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.670771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.671246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.672618 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:09.673816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.685370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 941/1923] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:09.686416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.690335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:09.694430 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3404f-dc6c-48d6-bd81-fdbe33a4b068 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.699644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.700341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.717302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.717302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] PATH_INFO: `/v3/projects/953b27767c8b497faa18bbfa6f20f92b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.717302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953b27767c8b497faa18bbfa6f20f92b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.717302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.750472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19a406-1c99-4393-8b46-e6759d3282ec admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.754103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.754696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.754968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.755236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.763491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.764958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.773654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 942/1924] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:09.774446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.785243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae3879-d824-49e3-8506-a878dbadb5a9 service glance] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:09.790155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468446f6-3f23-4d82-ba67-b08f9f52df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:09.790775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468446f6-3f23-4d82-ba67-b08f9f52df9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.791212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468446f6-3f23-4d82-ba67-b08f9f52df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.791368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468446f6-3f23-4d82-ba67-b08f9f52df9e admin admin] PATH_INFO: `/v3/projects/4a39b978d01c45f89f0945632d855aa2/users/4ae027cec67e40eeae1f607ebfc95c98/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.793288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468446f6-3f23-4d82-ba67-b08f9f52df9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a39b978d01c45f89f0945632d855aa2, user_id=4ae027cec67e40eeae1f607ebfc95c98, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:09.796266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468446f6-3f23-4d82-ba67-b08f9f52df9e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:09.809516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 943/1925] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:09 2022] PUT /identity/v3/projects/4a39b978d01c45f89f0945632d855aa2/users/4ae027cec67e40eeae1f607ebfc95c98/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:09.821306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.821673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.822008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.838675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953b27767c8b497faa18bbfa6f20f92b', 'request_id': 'req-41066f53-bac0-4be1-9580-18e8c39c9b43'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:09.845425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953b27767c8b497faa18bbfa6f20f92b', 'request_id': 'req-41066f53-bac0-4be1-9580-18e8c39c9b43'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:09.857999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953b27767c8b497faa18bbfa6f20f92b', 'request_id': 'req-41066f53-bac0-4be1-9580-18e8c39c9b43'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:09.862321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] MFA Rules not processed for user `4ae027cec67e40eeae1f607ebfc95c98`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:09.863612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:09.953553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] The token cache is being invalidate because project 953b27767c8b497faa18bbfa6f20f92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:09.953553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:09.955024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41066f53-bac0-4be1-9580-18e8c39c9b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:09.960489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 983/1926] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:09 2022] DELETE /identity/v3/projects/953b27767c8b497faa18bbfa6f20f92b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:09.962893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52467-9733-4640-8612-d198251d2246 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:09.963557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52467-9733-4640-8612-d198251d2246 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:09.963839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52467-9733-4640-8612-d198251d2246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:09.977274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 944/1927] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:09.989346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:09.990859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.003474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cbd52467-9733-4640-8612-d198251d2246 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:10.005204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cbd52467-9733-4640-8612-d198251d2246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.084232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0e7f7-9d83-4093-b689-801138f1fea0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.094371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.095862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.096378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.096770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.098286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 984/1928] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:10.099360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.114271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.114627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.114964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.120459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.120459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.134097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 945/1929] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:10.152703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:10.155217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.168643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 985/1930] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:10.173729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.189516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c9aa1-52c0-4734-9ea2-1e84aecf6ea4 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.194498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.195258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.195542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.195813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.196496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:10.196809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.198399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.211995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.213400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.215289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 946/1931] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:43:10.226846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.232503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d401e46-9a1b-4e42-870c-4512b845ba42 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.238894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373d41-e27d-40e3-b3e7-6b9af647bc57 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.241163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.242330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.242786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.243225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] PATH_INFO: `/v3/users/9df5760263f3479bb4a95acf3ab3ee31` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.244759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.249211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df5760263f3479bb4a95acf3ab3ee31)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.249867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.249867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.249867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.249867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.250189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.250274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.376947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 947/1932] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:10 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:10.378156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.440575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff900f7-1df4-414a-9589-5b8cc9978915 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.445310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.445917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.446200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.446506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.447136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.449099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.473965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:10.488126 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df5760263f3479bb4a95acf3ab3ee31'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:10.495124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df5760263f3479bb4a95acf3ab3ee31'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:10.495808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df5760263f3479bb4a95acf3ab3ee31'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:10.496404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df5760263f3479bb4a95acf3ab3ee31'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:10.536893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 948/1933] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:10 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:10.541065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.542628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.554177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a65c1-74f5-4ad6-a70b-d45bb75d22c1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.558786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.559293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.559570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.559837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.560530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.562125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.570662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:10.574186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 949/1934] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:10.580792 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.591318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291386b0-8de4-4b9c-9945-4b08c3fd7966 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.597351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.597944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.598238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.598488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.599114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.601193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.615551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 950/1935] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:10.616806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.626286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb83d5a-5308-4a79-adc8-f4b46bbaa6e6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.630805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95944-4b62-4df1-b854-3d059fd03d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.631431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95944-4b62-4df1-b854-3d059fd03d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.631703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95944-4b62-4df1-b854-3d059fd03d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.631973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95944-4b62-4df1-b854-3d059fd03d39 admin admin] PATH_INFO: `/v3/projects/598eb929657c43d7b4a19bbdb03f2457/users/b1bf95567dc046dc954fd36ab8a270be/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.633674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9549453a-32de-4a79-975b-2dac22441f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df5760263f3479bb4a95acf3ab3ee31'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:10.652062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95944-4b62-4df1-b854-3d059fd03d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598eb929657c43d7b4a19bbdb03f2457, user_id=b1bf95567dc046dc954fd36ab8a270be, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.655074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95944-4b62-4df1-b854-3d059fd03d39 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.657554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 986/1936] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:10 2022] DELETE /identity/v3/users/9df5760263f3479bb4a95acf3ab3ee31 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:10.662058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.662339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.662613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.683993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:10.685905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.737500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 951/1937] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:10 2022] PUT /identity/v3/projects/598eb929657c43d7b4a19bbdb03f2457/users/b1bf95567dc046dc954fd36ab8a270be/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:10.740227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118816-af1a-4004-917f-944e8bd125cc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.740378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118816-af1a-4004-917f-944e8bd125cc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.740685 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118816-af1a-4004-917f-944e8bd125cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.786710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-53118816-af1a-4004-917f-944e8bd125cc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:10.787933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-53118816-af1a-4004-917f-944e8bd125cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.790951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 987/1938] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:10.797109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.799791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:10.865702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 952/1939] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:10.865863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df390e-aaf0-4e93-8f06-aa924407689e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.886029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118816-af1a-4004-917f-944e8bd125cc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:10.934500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.935116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.935383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.935634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.946364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.947935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.959694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 988/1940] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:10.964256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118816-af1a-4004-917f-944e8bd125cc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:10.968161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:10.968793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:10.969067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:10.969334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:10.979798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:10.981364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:10.991065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 953/1941] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:11.546053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:11.548119 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:11.558954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:11.565880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450f5ec-5290-48bb-bab0-e609480c7a3f service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:11.571177 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:11.571885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:11.577024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:11.577442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] PATH_INFO: `/v3/projects/98adfe003ac24253894a6e59459cf6c3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:11.578750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98adfe003ac24253894a6e59459cf6c3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:11.580905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:11.682766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:11.751891 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98adfe003ac24253894a6e59459cf6c3', 'request_id': 'req-d25bf91e-1e16-4416-854b-3327a9676952'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:11.762881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98adfe003ac24253894a6e59459cf6c3', 'request_id': 'req-d25bf91e-1e16-4416-854b-3327a9676952'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:11.769991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98adfe003ac24253894a6e59459cf6c3', 'request_id': 'req-d25bf91e-1e16-4416-854b-3327a9676952'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:11.917903 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] The token cache is being invalidate because project 98adfe003ac24253894a6e59459cf6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:11.918258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:11.921083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d25bf91e-1e16-4416-854b-3327a9676952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:11.921083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 989/1942] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:11 2022] DELETE /identity/v3/projects/98adfe003ac24253894a6e59459cf6c3 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:11.924470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:11.934395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e60fc-d70f-4453-b7dd-38546bcac221 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:12.066995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:12.067985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:12.068412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:12.068726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] PATH_INFO: `/v3/users/4ae027cec67e40eeae1f607ebfc95c98` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:12.069888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae027cec67e40eeae1f607ebfc95c98)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:12.071988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:12.420017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae027cec67e40eeae1f607ebfc95c98'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.420804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae027cec67e40eeae1f607ebfc95c98'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.435364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae027cec67e40eeae1f607ebfc95c98'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.445632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae027cec67e40eeae1f607ebfc95c98'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.527742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae027cec67e40eeae1f607ebfc95c98'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:12.535405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 954/1943] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:11 2022] DELETE /identity/v3/users/4ae027cec67e40eeae1f607ebfc95c98 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:12.685389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:12.685924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:12.686017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:12.718916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] MFA Rules not processed for user `b1bf95567dc046dc954fd36ab8a270be`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:12.720156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:12.793638 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 990/1944] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:12.806923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:12.809098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:12.901869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5c70-a3e2-4761-81bd-14e7f403fcf9 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:12.906732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfe0c6-25f3-4788-92b0-ecee541359b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:12.907392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe0c6-25f3-4788-92b0-ecee541359b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:12.907674 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe0c6-25f3-4788-92b0-ecee541359b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:12.908093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe0c6-25f3-4788-92b0-ecee541359b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:12.918084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfe0c6-25f3-4788-92b0-ecee541359b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:12.919527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfe0c6-25f3-4788-92b0-ecee541359b9 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:12.929579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 955/1945] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:13.101104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:13.102839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:13.216136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655599a1-d003-47be-8f5c-3f6f88582133 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:13.222550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:13.223187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.223493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.223723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] PATH_INFO: `/v3/projects/4a39b978d01c45f89f0945632d855aa2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.224897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a39b978d01c45f89f0945632d855aa2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:13.226944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:13.279339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:13.388421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:13.410330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a39b978d01c45f89f0945632d855aa2', 'request_id': 'req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.416687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a39b978d01c45f89f0945632d855aa2', 'request_id': 'req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.427029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a39b978d01c45f89f0945632d855aa2', 'request_id': 'req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.566352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] The token cache is being invalidate because project 4a39b978d01c45f89f0945632d855aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:13.566745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.567781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ce86dfc-8d8c-4146-b5d1-036980b5c2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:13.570334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 991/1946] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:13 2022] DELETE /identity/v3/projects/4a39b978d01c45f89f0945632d855aa2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:13.575313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa3302-f0c9-4822-a1ad-118e9923af94 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.575594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa3302-f0c9-4822-a1ad-118e9923af94 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.575874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa3302-f0c9-4822-a1ad-118e9923af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.603071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d6aa3302-f0c9-4822-a1ad-118e9923af94 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:13.604348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d6aa3302-f0c9-4822-a1ad-118e9923af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:13.683314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 956/1947] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:13.690933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb347ac-7e82-424e-bc97-8bd8a1c46e52 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.691643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb347ac-7e82-424e-bc97-8bd8a1c46e52 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.691643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb347ac-7e82-424e-bc97-8bd8a1c46e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.712717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9bb347ac-7e82-424e-bc97-8bd8a1c46e52 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:13.713918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9bb347ac-7e82-424e-bc97-8bd8a1c46e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:13.722988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 992/1948] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:13.730037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa3302-f0c9-4822-a1ad-118e9923af94 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:13.739688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa3302-f0c9-4822-a1ad-118e9923af94 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:13.744266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:13.744883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.745158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.745422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.746062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:13.746356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:13.748294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:13.759624 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 957/1949] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:13.767092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb347ac-7e82-424e-bc97-8bd8a1c46e52 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:13.776949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb347ac-7e82-424e-bc97-8bd8a1c46e52 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:13.781811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:13.782956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:13.783230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:13.783498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:13.784132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:13.786263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:13.918997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 993/1950] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:13 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:13.923765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:13.936370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19059cd1-7d0d-499a-8979-7760ef628fc0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.045574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.046208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.046486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.046760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.047931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.049911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.153957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 958/1951] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:13 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:14.155180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.169141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47cf6-f273-4735-bdb2-c19cc9318acd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.183617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.183617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.183617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.183617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.183974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.183974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.189046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 994/1952] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:14.193082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.203241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da4be-a49c-4688-be84-ed7853a8ff8f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.209258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b658-0ebe-4a02-89e1-b7e6bc20ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.211655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b658-0ebe-4a02-89e1-b7e6bc20ad89 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.212132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b658-0ebe-4a02-89e1-b7e6bc20ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.212579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b658-0ebe-4a02-89e1-b7e6bc20ad89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.213395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03b658-0ebe-4a02-89e1-b7e6bc20ad89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.215045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03b658-0ebe-4a02-89e1-b7e6bc20ad89 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.227851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 959/1953] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:14.233518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.244170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d918f8f-a301-4e0f-8dc9-85edab3b3033 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.248924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.252151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.252151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.252151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] PATH_INFO: `/v3/projects/d11b85b6687746d491760909b9cbaa74/users/5655c98517254e0a83fdf3ae3f167b77/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.266944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11b85b6687746d491760909b9cbaa74, user_id=5655c98517254e0a83fdf3ae3f167b77, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.275417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.396816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 995/1954] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:14 2022] PUT /identity/v3/projects/d11b85b6687746d491760909b9cbaa74/users/5655c98517254e0a83fdf3ae3f167b77/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:14.408538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82452de9-cbf1-4d84-854f-c76e350ebdcf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.408854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82452de9-cbf1-4d84-854f-c76e350ebdcf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.409129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82452de9-cbf1-4d84-854f-c76e350ebdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.436207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-82452de9-cbf1-4d84-854f-c76e350ebdcf None None] MFA Rules not processed for user `5655c98517254e0a83fdf3ae3f167b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:14.437457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-82452de9-cbf1-4d84-854f-c76e350ebdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:14.502683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 960/1955] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:14.507213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.570651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7641-140a-462a-9024-50dc3d367c24 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.575232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.575834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.576115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.576383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.577044 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.578940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.588240 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:14.686559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 996/1956] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:14.687927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82452de9-cbf1-4d84-854f-c76e350ebdcf None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.699087 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82452de9-cbf1-4d84-854f-c76e350ebdcf None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.759350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.762491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.762491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.762491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.762491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.763297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.854683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 961/1957] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:14 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:14.855840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.871999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9635-5d86-4d77-9248-cacd68368aae admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.877449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.878086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.878360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.878626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.879378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.881043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.892417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 997/1958] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:14.896711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:14.907229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc40c2-2f0b-4e01-89e4-466c21dd90cc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:14.914299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:14.914299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:14.914299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:14.914299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] PATH_INFO: `/v3/projects/9eccbb9505224702b6ed573381b30e7d/users/07df7fa88d094d528df7f5a8f70b224f/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:14.928284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eccbb9505224702b6ed573381b30e7d, user_id=07df7fa88d094d528df7f5a8f70b224f, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:14.931381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:14.985376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:15.110511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 962/1959] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:14 2022] PUT /identity/v3/projects/9eccbb9505224702b6ed573381b30e7d/users/07df7fa88d094d528df7f5a8f70b224f/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:15.114456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.124573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2047ed-0995-4409-8c85-cebd9a1b3c09 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.185323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a63d6-2136-464f-a646-f9a3a5b8e930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.185982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a63d6-2136-464f-a646-f9a3a5b8e930 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.186262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a63d6-2136-464f-a646-f9a3a5b8e930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.186528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a63d6-2136-464f-a646-f9a3a5b8e930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.187166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a63d6-2136-464f-a646-f9a3a5b8e930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.189283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a63d6-2136-464f-a646-f9a3a5b8e930 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.202919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 998/1960] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:15.204285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.231522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ce854-d761-4bf9-a64e-1cef7d73505a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.231522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.231522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.231522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.231825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] PATH_INFO: `/v3/projects/9eccbb9505224702b6ed573381b30e7d/users/07df7fa88d094d528df7f5a8f70b224f/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.231825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eccbb9505224702b6ed573381b30e7d, user_id=07df7fa88d094d528df7f5a8f70b224f, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.231825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.237248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 963/1961] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:15 2022] PUT /identity/v3/projects/9eccbb9505224702b6ed573381b30e7d/users/07df7fa88d094d528df7f5a8f70b224f/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:15.247221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739990d-b1d7-42a5-a3a8-6b95a7695dab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.247518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739990d-b1d7-42a5-a3a8-6b95a7695dab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.247789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739990d-b1d7-42a5-a3a8-6b95a7695dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.277197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e739990d-b1d7-42a5-a3a8-6b95a7695dab None None] MFA Rules not processed for user `07df7fa88d094d528df7f5a8f70b224f`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:15.278419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e739990d-b1d7-42a5-a3a8-6b95a7695dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.345492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 999/1962] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:15.355963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.357692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:15.423756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f726e63-7393-464f-9546-cd1aaf54ecef admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.427742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a0692-4b3e-435a-a019-7f7f3a993faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.428851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0692-4b3e-435a-a019-7f7f3a993faf service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.428851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0692-4b3e-435a-a019-7f7f3a993faf service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.429045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a0692-4b3e-435a-a019-7f7f3a993faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.459778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a0692-4b3e-435a-a019-7f7f3a993faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.459778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a0692-4b3e-435a-a019-7f7f3a993faf service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.459778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 964/1963] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:15.580666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739990d-b1d7-42a5-a3a8-6b95a7695dab None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:15.590392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739990d-b1d7-42a5-a3a8-6b95a7695dab None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:15.595320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955db56-f921-41a7-999f-dc8ba713b1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:15.595947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955db56-f921-41a7-999f-dc8ba713b1fa service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:15.596221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955db56-f921-41a7-999f-dc8ba713b1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:15.596579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955db56-f921-41a7-999f-dc8ba713b1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:15.656330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955db56-f921-41a7-999f-dc8ba713b1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:15.657971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955db56-f921-41a7-999f-dc8ba713b1fa service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:15.668822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1000/1964] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:16.133238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:16.133644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:16.133740 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:16.152531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] MFA Rules not processed for user `b1bf95567dc046dc954fd36ab8a270be`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:16.153749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:16.174761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:16.210907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 965/1965] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:16.256585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:17.616291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:18.049023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e5ed-25cf-423d-8faf-6d48a598a659 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.049403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e5ed-25cf-423d-8faf-6d48a598a659 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.049786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9e5ed-25cf-423d-8faf-6d48a598a659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.069240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8de9e5ed-25cf-423d-8faf-6d48a598a659 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:18.080332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8de9e5ed-25cf-423d-8faf-6d48a598a659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:18.130836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1001/1966] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:18.183468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:18.183468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:18.248517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650898c-5d91-4532-84c2-2b4a15eb39de None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:18.253949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:18.254545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:18.254817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:18.255080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:18.263392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:18.275200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:18.275200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 966/1967] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:43:18.344994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:19.562824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0244-696e-4ed5-906c-ed8b36ddaf7d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.563329 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0244-696e-4ed5-906c-ed8b36ddaf7d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.563429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0244-696e-4ed5-906c-ed8b36ddaf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.584064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-616e0244-696e-4ed5-906c-ed8b36ddaf7d None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:19.585294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-616e0244-696e-4ed5-906c-ed8b36ddaf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:19.592424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1002/1968] 10.222.0.39 () {58 vars in 967 bytes} [Wed Nov 2 07:43:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:19.606597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:19.618187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33bb1-56a7-406f-9dcd-0a52da287a7f service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:19.623180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7232cc-dbef-4f99-8555-90331d20a1c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:19.623767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7232cc-dbef-4f99-8555-90331d20a1c8 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:19.624043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7232cc-dbef-4f99-8555-90331d20a1c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:19.624336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7232cc-dbef-4f99-8555-90331d20a1c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:19.632335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7232cc-dbef-4f99-8555-90331d20a1c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:19.633778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7232cc-dbef-4f99-8555-90331d20a1c8 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:19.641971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 967/1969] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:43:20.216596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:20.296452 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:20.310036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e0244-696e-4ed5-906c-ed8b36ddaf7d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:20.399623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e0244-696e-4ed5-906c-ed8b36ddaf7d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:20.404790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:20.405436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:20.405715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:20.405988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] PATH_INFO: `/v3/users/5655c98517254e0a83fdf3ae3f167b77` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:20.407149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5655c98517254e0a83fdf3ae3f167b77)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:20.409197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:20.543456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f93d1-a222-45ec-8784-bab79234bea4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:20.543739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f93d1-a222-45ec-8784-bab79234bea4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:20.544009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f93d1-a222-45ec-8784-bab79234bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:20.564603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6e3f93d1-a222-45ec-8784-bab79234bea4 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:20.565877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6e3f93d1-a222-45ec-8784-bab79234bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:20.574915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 968/1970] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:20.586915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f93d1-a222-45ec-8784-bab79234bea4 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:20.598992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f93d1-a222-45ec-8784-bab79234bea4 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:20.604108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3a99-3e9e-4dd8-8fb6-bd069c89c22d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:20.604755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3a99-3e9e-4dd8-8fb6-bd069c89c22d service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:20.605034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3a99-3e9e-4dd8-8fb6-bd069c89c22d service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:20.605306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3a99-3e9e-4dd8-8fb6-bd069c89c22d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:20.614275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae3a99-3e9e-4dd8-8fb6-bd069c89c22d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:20.615984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae3a99-3e9e-4dd8-8fb6-bd069c89c22d service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:20.624375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 969/1971] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:43:20.739261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5655c98517254e0a83fdf3ae3f167b77'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:20.746172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5655c98517254e0a83fdf3ae3f167b77'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:20.747054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5655c98517254e0a83fdf3ae3f167b77'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:20.747685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5655c98517254e0a83fdf3ae3f167b77'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:20.879359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5655c98517254e0a83fdf3ae3f167b77'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:20.923535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1003/1972] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:20 2022] DELETE /identity/v3/users/5655c98517254e0a83fdf3ae3f167b77 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:20.923772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3829b0-c607-4a49-afc4-e2ba613c91ba None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:20.923772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3829b0-c607-4a49-afc4-e2ba613c91ba None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:20.923772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3829b0-c607-4a49-afc4-e2ba613c91ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:20.943945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4b3829b0-c607-4a49-afc4-e2ba613c91ba None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:20.945188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4b3829b0-c607-4a49-afc4-e2ba613c91ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:21.007932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 970/1973] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:21.017700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:21.019190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:21.077031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f89eb-6842-460b-a18b-7b25e33e80e9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:21.081319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:21.081932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:21.082206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:21.082472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:21.091591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:21.093049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:21.102956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1004/1974] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:21.139262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:21.218678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:21.590542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:21.590835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:21.591125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:21.611038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:21.612225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:21.654856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:21.664489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:21.687244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 971/1975] 10.222.0.39 () {58 vars in 967 bytes} [Wed Nov 2 07:43:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:21.690033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1406cd-ff11-402b-9851-ebf7a1d263ae service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:21.694593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:21.695207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:21.695479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:21.695779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] PATH_INFO: `/v3/projects/d11b85b6687746d491760909b9cbaa74` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:21.696945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11b85b6687746d491760909b9cbaa74)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:21.698833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:21.703023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:21.704969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:21.780060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc261535-30bc-4417-a0e7-11a6d44a8878 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:21.791768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:21.792590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:21.792949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:21.793306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:21.801983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:21.803578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:21.811933 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 972/1976] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:43:21.934005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11b85b6687746d491760909b9cbaa74', 'request_id': 'req-aac73ea7-6218-4972-a832-306c303c5743'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.939415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11b85b6687746d491760909b9cbaa74', 'request_id': 'req-aac73ea7-6218-4972-a832-306c303c5743'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:21.947075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11b85b6687746d491760909b9cbaa74', 'request_id': 'req-aac73ea7-6218-4972-a832-306c303c5743'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.196122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] The token cache is being invalidate because project d11b85b6687746d491760909b9cbaa74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:22.196474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.197116 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.198721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1005/1977] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:21 2022] DELETE /identity/v3/projects/d11b85b6687746d491760909b9cbaa74 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:22.202879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:22.213567 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4ccc4-6699-4bb3-a3fb-0999ae0574a6 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:22.276890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:22.277519 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:22.277800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:22.278074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] PATH_INFO: `/v3/users/07df7fa88d094d528df7f5a8f70b224f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:22.279436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07df7fa88d094d528df7f5a8f70b224f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:22.281442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:22.324552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:22.605804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:22.712699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07df7fa88d094d528df7f5a8f70b224f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.713391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07df7fa88d094d528df7f5a8f70b224f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.733635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07df7fa88d094d528df7f5a8f70b224f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.742811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07df7fa88d094d528df7f5a8f70b224f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.867815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-905e798f-7f8f-4190-bdda-3b3c3c730c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07df7fa88d094d528df7f5a8f70b224f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:22.876845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 973/1978] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:22 2022] DELETE /identity/v3/users/07df7fa88d094d528df7f5a8f70b224f => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:23.637557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:23.656301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:23.656301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac73ea7-6218-4972-a832-306c303c5743 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:23.707347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:23.750481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:23.751194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:23.751545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:23.751927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] PATH_INFO: `/v3/projects/9eccbb9505224702b6ed573381b30e7d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:23.753347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eccbb9505224702b6ed573381b30e7d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:23.755817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:23.948128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eccbb9505224702b6ed573381b30e7d', 'request_id': 'req-7c946794-14b7-432d-bb81-21bfab2e9fc6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:23.955381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eccbb9505224702b6ed573381b30e7d', 'request_id': 'req-7c946794-14b7-432d-bb81-21bfab2e9fc6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:23.965686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eccbb9505224702b6ed573381b30e7d', 'request_id': 'req-7c946794-14b7-432d-bb81-21bfab2e9fc6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:24.132946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] The token cache is being invalidate because project 9eccbb9505224702b6ed573381b30e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:24.133241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:24.133860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7c946794-14b7-432d-bb81-21bfab2e9fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:24.135579 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1006/1979] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:23 2022] DELETE /identity/v3/projects/9eccbb9505224702b6ed573381b30e7d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:24.142226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319912-47ee-45d5-8e4e-168794f9e72e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.142226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319912-47ee-45d5-8e4e-168794f9e72e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.142226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319912-47ee-45d5-8e4e-168794f9e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.161354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-56319912-47ee-45d5-8e4e-168794f9e72e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:24.162544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-56319912-47ee-45d5-8e4e-168794f9e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:24.229488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 974/1980] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:24.237194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaa21e-dd2e-44f9-859b-8154fb78ca01 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.237718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaa21e-dd2e-44f9-859b-8154fb78ca01 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.238228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaa21e-dd2e-44f9-859b-8154fb78ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.259242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-89eaa21e-dd2e-44f9-859b-8154fb78ca01 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:24.260737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-89eaa21e-dd2e-44f9-859b-8154fb78ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:24.269312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1007/1981] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:24.277591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319912-47ee-45d5-8e4e-168794f9e72e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.288234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319912-47ee-45d5-8e4e-168794f9e72e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.292914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.293616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.293966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.294237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.294883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:24.295180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.296800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.310405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 975/1982] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:24.315297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaa21e-dd2e-44f9-859b-8154fb78ca01 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.326305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaa21e-dd2e-44f9-859b-8154fb78ca01 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.331656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.333251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.333755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.334033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.335291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.336755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.437980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1008/1983] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:24 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:24.441940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.452217 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95153c3-85f6-4582-b5b1-cbb8d9e5c873 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.511656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.512252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.512568 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.512844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.513481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.515457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.668978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 976/1984] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:24 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:24.669990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.681058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4b330-9aa6-453b-941c-d13c9470726c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.685807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.686463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.686745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.687019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.688325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.689987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.701462 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1009/1985] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:24.708041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.718964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16a33-a69e-4b34-b489-a160556363c3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.724988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b420f6-cb6f-459a-9606-9cf0ce27d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.725605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b420f6-cb6f-459a-9606-9cf0ce27d521 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.725886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b420f6-cb6f-459a-9606-9cf0ce27d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.726164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b420f6-cb6f-459a-9606-9cf0ce27d521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.726828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b420f6-cb6f-459a-9606-9cf0ce27d521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.728755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b420f6-cb6f-459a-9606-9cf0ce27d521 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.754063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 977/1986] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:24.754673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:24.767746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e92e-d7e0-4129-9b9a-6b8d6c41035d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:24.773550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:24.774273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:24.774556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:24.774831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] PATH_INFO: `/v3/projects/1047e76a06ab4570bcd62a87840b6036/users/f739c6726f444d7fbdf840b9c48ff856/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:24.800873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1047e76a06ab4570bcd62a87840b6036, user_id=f739c6726f444d7fbdf840b9c48ff856, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:24.803856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:24.835923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:24.992945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1010/1987] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:24 2022] PUT /identity/v3/projects/1047e76a06ab4570bcd62a87840b6036/users/f739c6726f444d7fbdf840b9c48ff856/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:25.004761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3b076-55e4-4e72-a34b-9c1fd957c329 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.005137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3b076-55e4-4e72-a34b-9c1fd957c329 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.005414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3b076-55e4-4e72-a34b-9c1fd957c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.032650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-cfe3b076-55e4-4e72-a34b-9c1fd957c329 None None] MFA Rules not processed for user `f739c6726f444d7fbdf840b9c48ff856`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:25.033849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-cfe3b076-55e4-4e72-a34b-9c1fd957c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:25.096451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 978/1988] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:25.100931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.265912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9999986-aa25-45bb-b02f-1fc62d4022b1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.270590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.271214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.273737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.273737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.273737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.274302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.390586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1011/1989] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:25 2022] POST /identity/v3/projects => generated 389 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:25.394523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3b076-55e4-4e72-a34b-9c1fd957c329 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.409071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3b076-55e4-4e72-a34b-9c1fd957c329 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.420998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.423875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:25.470114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.470682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.471014 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.471308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.471955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.473910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.491476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca6f99-324e-42d0-965a-671ce354347f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.496179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.496834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.497114 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.497389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] PATH_INFO: `/v3/users/3d4939a139b8495bb51181567993339a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.498555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4939a139b8495bb51181567993339a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.500628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.527487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:25.608491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 979/1990] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:25 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:25.610276 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.622669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daa097-ab2f-4509-90e8-4cb61b40102b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.627572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.632656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.632656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.632656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.632656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.632656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.641596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 980/1991] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:25.645653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.655640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa79a0f-51a3-4325-92d0-39c1613a58f4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.662399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.663108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.663384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.667162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] PATH_INFO: `/v3/projects/52d18d6c5a36430da96ddda4da1c16ba/users/bba1267793644a76a8d5ad6211a091ed/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.679583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d18d6c5a36430da96ddda4da1c16ba, user_id=bba1267793644a76a8d5ad6211a091ed, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.682365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.843017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 981/1992] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:25 2022] PUT /identity/v3/projects/52d18d6c5a36430da96ddda4da1c16ba/users/bba1267793644a76a8d5ad6211a091ed/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:25.847344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.857703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4939a139b8495bb51181567993339a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:25.873123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4939a139b8495bb51181567993339a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:25.875434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4939a139b8495bb51181567993339a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:25.876188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4939a139b8495bb51181567993339a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:25.954034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca89c-d137-4151-8021-d74ca357fccc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:25.959619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:25.959619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:25.959851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:25.960105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:25.960844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:25.962888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:25.975468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 982/1993] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:25.979410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:25.981157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:25.993186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb53c2b8-0535-437f-9150-7f3a3ef5705b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4939a139b8495bb51181567993339a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.005892 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467833c7-10a5-46a9-b14f-46d23629340d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.011272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280765a3-1aac-4f46-b05f-c55cfde4ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.012015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280765a3-1aac-4f46-b05f-c55cfde4ba08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.012300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280765a3-1aac-4f46-b05f-c55cfde4ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.012936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280765a3-1aac-4f46-b05f-c55cfde4ba08 admin admin] PATH_INFO: `/v3/projects/52d18d6c5a36430da96ddda4da1c16ba/users/bba1267793644a76a8d5ad6211a091ed/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.017207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280765a3-1aac-4f46-b05f-c55cfde4ba08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d18d6c5a36430da96ddda4da1c16ba, user_id=bba1267793644a76a8d5ad6211a091ed, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.021724 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1012/1994] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:25 2022] DELETE /identity/v3/users/3d4939a139b8495bb51181567993339a => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:26.024900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280765a3-1aac-4f46-b05f-c55cfde4ba08 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.026154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.026524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.026924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.050673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:26.052983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.061590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 983/1995] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:25 2022] PUT /identity/v3/projects/52d18d6c5a36430da96ddda4da1c16ba/users/bba1267793644a76a8d5ad6211a091ed/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:26.072318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.072655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.072934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.107292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] MFA Rules not processed for user `bba1267793644a76a8d5ad6211a091ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:26.108578 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.140130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1013/1996] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:26.146945 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.148467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.201392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 984/1997] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:26.213377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.214802 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.217063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966de29-16e5-4073-a63f-670b92ec8f4e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.221768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.221970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.222076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.222333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.232845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.234350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.245075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1014/1998] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:26.280063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9578e7-101e-4fbe-93eb-b1baf78d1237 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.285337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.285978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.286254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.286524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.298283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.300224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.311951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 985/1999] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:26.486263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.507685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d20c91-017a-4dd2-9ae7-5380d0866222 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.516124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.516800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.517080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.517353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] PATH_INFO: `/v3/users/f739c6726f444d7fbdf840b9c48ff856` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.518493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f739c6726f444d7fbdf840b9c48ff856)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.520622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.623219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:26.624904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:26.639760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fa985-8e33-420d-be64-762bc47205a4 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:26.644993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:26.645621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:26.646114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:26.646391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] PATH_INFO: `/v3/projects/603211f8f6d046ef8a0e8a50e1b2421a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:26.648229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603211f8f6d046ef8a0e8a50e1b2421a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:26.652688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:26.765180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f739c6726f444d7fbdf840b9c48ff856'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.772532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f739c6726f444d7fbdf840b9c48ff856'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.773364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f739c6726f444d7fbdf840b9c48ff856'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.774073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f739c6726f444d7fbdf840b9c48ff856'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.836589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603211f8f6d046ef8a0e8a50e1b2421a', 'request_id': 'req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.843366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603211f8f6d046ef8a0e8a50e1b2421a', 'request_id': 'req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.850001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603211f8f6d046ef8a0e8a50e1b2421a', 'request_id': 'req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:26.956153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-66b35f5c-b084-4531-91e2-30674b0f9f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f739c6726f444d7fbdf840b9c48ff856'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:27.002393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1015/2000] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:26 2022] DELETE /identity/v3/users/f739c6726f444d7fbdf840b9c48ff856 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:27.009073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:27.016140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:27.016140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:27.030658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:27.032565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:27.055719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] The token cache is being invalidate because project 603211f8f6d046ef8a0e8a50e1b2421a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:27.056194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:27.057591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:27.060173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 986/2001] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:26 2022] DELETE /identity/v3/projects/603211f8f6d046ef8a0e8a50e1b2421a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:27.107708 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1016/2002] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:27.118497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:27.120185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:27.185587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bf13e-a1ee-4b74-ac18-566dc983e8d8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:27.286053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:27.286935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:27.287329 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:27.287669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:27.305529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:27.307307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:27.331917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 987/2003] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:27.992850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:27.992850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:28.004179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa746c8-48db-4809-a5b5-dfcabf3abce4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:28.009062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:28.011221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:28.011221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:28.011221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] PATH_INFO: `/v3/projects/1047e76a06ab4570bcd62a87840b6036` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:28.011836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1047e76a06ab4570bcd62a87840b6036)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:28.013987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:28.182685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1047e76a06ab4570bcd62a87840b6036', 'request_id': 'req-91d31b92-fac5-4318-ac48-702b07cb1e7f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.189202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1047e76a06ab4570bcd62a87840b6036', 'request_id': 'req-91d31b92-fac5-4318-ac48-702b07cb1e7f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.196203 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1047e76a06ab4570bcd62a87840b6036', 'request_id': 'req-91d31b92-fac5-4318-ac48-702b07cb1e7f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.210455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:28.356821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] The token cache is being invalidate because project 1047e76a06ab4570bcd62a87840b6036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:28.360478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.360478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.360478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1017/2004] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:27 2022] DELETE /identity/v3/projects/1047e76a06ab4570bcd62a87840b6036 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:28.363673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:28.374596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eade6-244a-4882-9cdb-3b31ce41d1d9 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:28.437883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:28.438692 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:28.438970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:28.439247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] PATH_INFO: `/v3/users/bba1267793644a76a8d5ad6211a091ed` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:28.440562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba1267793644a76a8d5ad6211a091ed)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:28.442814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:28.797998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba1267793644a76a8d5ad6211a091ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.798678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba1267793644a76a8d5ad6211a091ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.810762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba1267793644a76a8d5ad6211a091ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.817899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba1267793644a76a8d5ad6211a091ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.975709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-144867fc-0f15-455b-8347-c49836b34e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba1267793644a76a8d5ad6211a091ed'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:28.982224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 988/2005] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:28 2022] DELETE /identity/v3/users/bba1267793644a76a8d5ad6211a091ed => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:29.044685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:29.688927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:29.688927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.713049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d31b92-fac5-4318-ac48-702b07cb1e7f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:29.775627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:29.776576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.779386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.779386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] PATH_INFO: `/v3/projects/52d18d6c5a36430da96ddda4da1c16ba` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.780256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d18d6c5a36430da96ddda4da1c16ba)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:29.782373 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:29.920307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e2fe-ba1c-4ecd-8a8f-1924e7bfe566 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:29.920307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e2fe-ba1c-4ecd-8a8f-1924e7bfe566 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:29.920307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e2fe-ba1c-4ecd-8a8f-1924e7bfe566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:29.940137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-74e8e2fe-ba1c-4ecd-8a8f-1924e7bfe566 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:29.943711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-74e8e2fe-ba1c-4ecd-8a8f-1924e7bfe566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:29.959574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d18d6c5a36430da96ddda4da1c16ba', 'request_id': 'req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.966195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d18d6c5a36430da96ddda4da1c16ba', 'request_id': 'req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.973245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d18d6c5a36430da96ddda4da1c16ba', 'request_id': 'req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:29.999269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 989/2006] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:30.000714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.000999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.001273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.019726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] MFA Rules not processed for user `6db9f53e5e204abfb8f89a041b8c26a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:30.020951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.076280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 990/2007] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:30.077264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.078508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.141155 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] The token cache is being invalidate because project 52d18d6c5a36430da96ddda4da1c16ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:30.141664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:30.142097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ef77a69f-82e4-42ad-a29b-9aa22eccf6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:30.143622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1018/2008] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:29 2022] DELETE /identity/v3/projects/52d18d6c5a36430da96ddda4da1c16ba => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:30.157275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139f38-d962-427c-9749-05602491d2f2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.157573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139f38-d962-427c-9749-05602491d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.157866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139f38-d962-427c-9749-05602491d2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.165931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed62b2-30b3-4822-8595-15f3e62b26bb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.185510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafa215-dfa6-4606-a155-d7b8bff92b4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.187007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa215-dfa6-4606-a155-d7b8bff92b4e service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.187007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa215-dfa6-4606-a155-d7b8bff92b4e service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.187007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafa215-dfa6-4606-a155-d7b8bff92b4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.188305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2eafa215-dfa6-4606-a155-d7b8bff92b4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.193276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1a139f38-d962-427c-9749-05602491d2f2 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:30.194648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1a139f38-d962-427c-9749-05602491d2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.253596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa215-dfa6-4606-a155-d7b8bff92b4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.255283 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafa215-dfa6-4606-a155-d7b8bff92b4e service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.263677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 991/2009] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:43:30.263946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1019/2010] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:30.272707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5e1c-a408-4bfe-9d38-cdd5ae02dfca None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.272990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5e1c-a408-4bfe-9d38-cdd5ae02dfca None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.273265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5e1c-a408-4bfe-9d38-cdd5ae02dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.293714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-80be5e1c-a408-4bfe-9d38-cdd5ae02dfca None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:30.294921 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-80be5e1c-a408-4bfe-9d38-cdd5ae02dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:30.303510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 992/2011] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:30.307859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139f38-d962-427c-9749-05602491d2f2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.318094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139f38-d962-427c-9749-05602491d2f2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.337010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.337010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.337010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.337010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.337304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:30.337304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.337304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.339539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1020/2012] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:30.345380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5e1c-a408-4bfe-9d38-cdd5ae02dfca None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.354488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5e1c-a408-4bfe-9d38-cdd5ae02dfca None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.359348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.359947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.360227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.360535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.361167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.363064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.577539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 993/2013] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/projects => generated 397 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:30.582258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.592128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86568-60e6-4f1a-8438-22464c53132f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.661957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.661957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.661957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.661957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.662344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.662344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.864598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1021/2014] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:30 2022] POST /identity/v3/users => generated 299 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:30.865626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.884513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16da85-4c58-4c4e-b945-44b811890af7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.891818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.892784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.893190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.893366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.894156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.895800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:30.945926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 994/2015] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:30.948747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:30.984988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96c28-26b2-4cac-bbdb-4ad9fec0266d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:30.993314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a94b0c-cf85-40fc-912d-8b00a5a3f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:30.994679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94b0c-cf85-40fc-912d-8b00a5a3f483 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:30.994679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94b0c-cf85-40fc-912d-8b00a5a3f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:30.994679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a94b0c-cf85-40fc-912d-8b00a5a3f483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:30.995255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a94b0c-cf85-40fc-912d-8b00a5a3f483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:30.997599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a94b0c-cf85-40fc-912d-8b00a5a3f483 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.012687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1022/2016] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:31.015388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:31.026605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7cc86-ab5c-42b6-ada4-1096f0a73207 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:31.032261 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:31.032953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.033233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.033503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] PATH_INFO: `/v3/projects/fa403009fe284a3fa4a0d88722c8c5ee/users/708b55fb019e488f899821874b204729/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.054300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa403009fe284a3fa4a0d88722c8c5ee, user_id=708b55fb019e488f899821874b204729, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.057033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.220160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 995/2017] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:31 2022] PUT /identity/v3/projects/fa403009fe284a3fa4a0d88722c8c5ee/users/708b55fb019e488f899821874b204729/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:31.231521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.232009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.232112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.285199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] MFA Rules not processed for user `708b55fb019e488f899821874b204729`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:31.287635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:31.374701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1023/2018] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:31.413960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:31.416361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:31.485983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe0edb-c930-49fd-8d4b-9952e9794ab8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:31.499246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a127a56-437a-4b47-bd9b-a8a0e9a29af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:31.499246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127a56-437a-4b47-bd9b-a8a0e9a29af5 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:31.499246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127a56-437a-4b47-bd9b-a8a0e9a29af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:31.499246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a127a56-437a-4b47-bd9b-a8a0e9a29af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:31.502572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a127a56-437a-4b47-bd9b-a8a0e9a29af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:31.505113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a127a56-437a-4b47-bd9b-a8a0e9a29af5 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:31.518248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 996/2019] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:31.532042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:34.524069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:36.323499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:37.423741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:37.425242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:37.501636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:37.510534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b26e-be7a-4d50-ac2e-b24243247b9b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:37.510534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:37.510534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:37.510534 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:37.510957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] PATH_INFO: `/v3/users/0edc147c80a943f3838845598a4d28b1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:37.511613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edc147c80a943f3838845598a4d28b1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:37.513556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:37.921242 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edc147c80a943f3838845598a4d28b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:37.951576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edc147c80a943f3838845598a4d28b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:37.953078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edc147c80a943f3838845598a4d28b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:37.953697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edc147c80a943f3838845598a4d28b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:38.058489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edc147c80a943f3838845598a4d28b1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:38.106808 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1024/2020] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:37 2022] DELETE /identity/v3/users/0edc147c80a943f3838845598a4d28b1 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:38.110289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.110783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.110871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.147136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:38.148632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.273596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 997/2021] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:43:38.282461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:38.285624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:38.371962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf522a-aa97-4f53-91a9-c988196aea72 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:38.380202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736c6d9-b9fc-4e9b-b7c0-0d2596403d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:38.380202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c6d9-b9fc-4e9b-b7c0-0d2596403d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:38.380202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c6d9-b9fc-4e9b-b7c0-0d2596403d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:38.380202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c6d9-b9fc-4e9b-b7c0-0d2596403d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:38.388324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736c6d9-b9fc-4e9b-b7c0-0d2596403d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:38.389907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736c6d9-b9fc-4e9b-b7c0-0d2596403d3b service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:38.401375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1025/2022] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:39.014910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.017425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:39.038219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:39.041820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f72bd-2300-4470-808b-9c1f443c5a35 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.057669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.058431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.058791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.058907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] PATH_INFO: `/v3/projects/67fcea3fc2a340959d1297ec1b99d23a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.060070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fcea3fc2a340959d1297ec1b99d23a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.063060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.270421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fcea3fc2a340959d1297ec1b99d23a', 'request_id': 'req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.272768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fcea3fc2a340959d1297ec1b99d23a', 'request_id': 'req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.281153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fcea3fc2a340959d1297ec1b99d23a', 'request_id': 'req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.414584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] The token cache is being invalidate because project 67fcea3fc2a340959d1297ec1b99d23a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:39.415962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.417864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6e808380-75ce-4b1a-bdf9-a3a1fd5040e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:39.420798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 998/2023] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:39 2022] DELETE /identity/v3/projects/67fcea3fc2a340959d1297ec1b99d23a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:39.425507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df944-589b-4b1e-acb4-73eabd90e3d3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.426042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df944-589b-4b1e-acb4-73eabd90e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.426657 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df944-589b-4b1e-acb4-73eabd90e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.462128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d83df944-589b-4b1e-acb4-73eabd90e3d3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:39.463799 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d83df944-589b-4b1e-acb4-73eabd90e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:39.563282 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1026/2024] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:39.571863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f557d-2af5-4327-8f53-d7efb3b9b9bc None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.572541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f557d-2af5-4327-8f53-d7efb3b9b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.573023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f557d-2af5-4327-8f53-d7efb3b9b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.598174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5c2f557d-2af5-4327-8f53-d7efb3b9b9bc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:39.599658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5c2f557d-2af5-4327-8f53-d7efb3b9b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:39.608906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 999/2025] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:39.613350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df944-589b-4b1e-acb4-73eabd90e3d3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.625356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df944-589b-4b1e-acb4-73eabd90e3d3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.631096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.633791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.633791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.633791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.633791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:39.633791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.635201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.651401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1027/2026] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:39.652623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f557d-2af5-4327-8f53-d7efb3b9b9bc None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.662923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f557d-2af5-4327-8f53-d7efb3b9b9bc None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.669438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.675506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.675506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.675506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.675506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.675506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:39.810453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1000/2027] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:39 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:39.814828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:39.838776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93760c0d-365f-4ad9-b954-4d7361525392 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:39.946214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:39.946893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:39.947233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:39.947721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:39.948954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:39.951161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.115420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1028/2028] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:39 2022] POST /identity/v3/users => generated 287 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:40.121309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.134299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636cfd-335f-4604-bc0a-72117d4a7d34 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.148271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.149128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.149511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.149918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.150708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.157288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.174876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1001/2029] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:40.175958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.193063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173051f-e82a-4b01-ac39-165081598eed admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.211957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964c3af-f2a5-46d1-af41-6df4781613b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.214545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c3af-f2a5-46d1-af41-6df4781613b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.214545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c3af-f2a5-46d1-af41-6df4781613b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.214545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964c3af-f2a5-46d1-af41-6df4781613b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.214545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c3af-f2a5-46d1-af41-6df4781613b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.218162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964c3af-f2a5-46d1-af41-6df4781613b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.241539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1029/2030] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:43:40.252340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.264137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2467f7-11b8-4661-9396-19291462f96b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.271153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.272570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.273175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.273648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] PATH_INFO: `/v3/projects/e4e2ca1715e14c599ba7a03350fcec38/users/1a4879b42ada4331bc3c79b4f868836b/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.295249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e2ca1715e14c599ba7a03350fcec38, user_id=1a4879b42ada4331bc3c79b4f868836b, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.300071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.445343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1002/2031] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:40 2022] PUT /identity/v3/projects/e4e2ca1715e14c599ba7a03350fcec38/users/1a4879b42ada4331bc3c79b4f868836b/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:40.456641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.457533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.458026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.473074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:40.504762 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] MFA Rules not processed for user `1a4879b42ada4331bc3c79b4f868836b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:40.507029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.598773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.600776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.639316 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1030/2032] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:40.656132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.658107 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:40.713198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ec5f9-a32b-4452-b4ef-fbe4177dd7a5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.720076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.720859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.721151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.721842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] PATH_INFO: `/v3/users/708b55fb019e488f899821874b204729` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.722962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] RBAC: Authorizing `identity:delete_user(user_id=708b55fb019e488f899821874b204729)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.724946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.754273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2df85-b342-4a3e-a25f-3360c1e7670c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.761324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.762456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.762946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.763464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.778670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.781356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:40.795525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1031/2033] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:40.851389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:40.865029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6eca11-424d-4760-a253-7d7ba353f0df service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:40.871757 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:40.872401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:40.872697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:40.872968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] PATH_INFO: `/v3/users/1a4879b42ada4331bc3c79b4f868836b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:40.874175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4879b42ada4331bc3c79b4f868836b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:40.876130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.080658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708b55fb019e488f899821874b204729'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.084724 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708b55fb019e488f899821874b204729'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.106348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708b55fb019e488f899821874b204729'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.123400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708b55fb019e488f899821874b204729'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.189370 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4879b42ada4331bc3c79b4f868836b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.197005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4879b42ada4331bc3c79b4f868836b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.197669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4879b42ada4331bc3c79b4f868836b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.198260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4879b42ada4331bc3c79b4f868836b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.289459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ca6058b9-645b-4d5e-b93f-f11c5215731f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708b55fb019e488f899821874b204729'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.296169 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1003/2034] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:40 2022] DELETE /identity/v3/users/708b55fb019e488f899821874b204729 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:41.300989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.301279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.301555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.327108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:41.327108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.379128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30bee84f-6eed-4428-9c5b-bb5b16d4a796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4879b42ada4331bc3c79b4f868836b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:41.415090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1032/2035] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:40 2022] DELETE /identity/v3/users/1a4879b42ada4331bc3c79b4f868836b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:41.420141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c45b-c478-4cce-aa2f-a9fc7d871207 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.421345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c45b-c478-4cce-aa2f-a9fc7d871207 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.423057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0c45b-c478-4cce-aa2f-a9fc7d871207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.425375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1004/2036] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:41.436371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:41.442268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.457302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eaf0c45b-c478-4cce-aa2f-a9fc7d871207 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:41.459756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eaf0c45b-c478-4cce-aa2f-a9fc7d871207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:41.521701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765d8d7-b565-4d90-8ef3-89ef626c107c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.539259 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1033/2037] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:41.553500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c45b-c478-4cce-aa2f-a9fc7d871207 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:41.606107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.608180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.609161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.609814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.627590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:41.631470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.634985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0c45b-c478-4cce-aa2f-a9fc7d871207 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:41.641173 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:41.641900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:41.642281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:41.642730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:41.651935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1005/2038] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:41.653334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:41.655091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:41.669393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1034/2039] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:43:42.247566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:42.495121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.500981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:42.536099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00127d0f-f008-471f-80ce-d126e4549530 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.547973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.548285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:42.549895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:42.550156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.550641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.551123 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] PATH_INFO: `/v3/projects/fa403009fe284a3fa4a0d88722c8c5ee` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.553334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa403009fe284a3fa4a0d88722c8c5ee)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.556893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.579908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c160d9-7e36-4a1b-8275-dbaa2e91253c service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:42.587971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:42.588904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:42.594104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:42.595378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] PATH_INFO: `/v3/projects/e4e2ca1715e14c599ba7a03350fcec38` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:42.597826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e2ca1715e14c599ba7a03350fcec38)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:42.600696 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:42.752154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa403009fe284a3fa4a0d88722c8c5ee', 'request_id': 'req-c912f0cc-2842-436c-9e65-162aa943d77d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.759035 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa403009fe284a3fa4a0d88722c8c5ee', 'request_id': 'req-c912f0cc-2842-436c-9e65-162aa943d77d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.767339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa403009fe284a3fa4a0d88722c8c5ee', 'request_id': 'req-c912f0cc-2842-436c-9e65-162aa943d77d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.790074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e2ca1715e14c599ba7a03350fcec38', 'request_id': 'req-d80caf0f-fcd3-46a7-b14c-56dee77c0246'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.795541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e2ca1715e14c599ba7a03350fcec38', 'request_id': 'req-d80caf0f-fcd3-46a7-b14c-56dee77c0246'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.801955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e2ca1715e14c599ba7a03350fcec38', 'request_id': 'req-d80caf0f-fcd3-46a7-b14c-56dee77c0246'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.882304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] The token cache is being invalidate because project fa403009fe284a3fa4a0d88722c8c5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:42.884342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.884342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c912f0cc-2842-436c-9e65-162aa943d77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:42.884857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1006/2040] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:42 2022] DELETE /identity/v3/projects/fa403009fe284a3fa4a0d88722c8c5ee => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:43.009219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] The token cache is being invalidate because project e4e2ca1715e14c599ba7a03350fcec38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:43.009578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:43.020261 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:43.021231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1035/2041] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:42 2022] DELETE /identity/v3/projects/e4e2ca1715e14c599ba7a03350fcec38 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:43.369389 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:43.815690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:44.590755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:44.649768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:44.852478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:45.332221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:45.744653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:45.790358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:46.204467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:46.246953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:46.382696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:46.572250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:46.641877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:46.973306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.069703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.320941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.426499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.583533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.741100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.844517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.926181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:47.959038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.107621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.243933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.287064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.486793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.532736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.689489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.717916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.896336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:48.941576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.069913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.126640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.538328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.612917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.695432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:49.967408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:50.027206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:50.223854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:50.275170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:50.458006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:50.575546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:50.680584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:51.021661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:51.155814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:51.312787 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:51.429144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:52.030609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:52.137533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:52.515634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:53.103285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1064c81-a12a-4b35-9550-76dd6ee4b8bf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.103770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1064c81-a12a-4b35-9550-76dd6ee4b8bf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.103878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1064c81-a12a-4b35-9550-76dd6ee4b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.129076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c1064c81-a12a-4b35-9550-76dd6ee4b8bf None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:53.130293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c1064c81-a12a-4b35-9550-76dd6ee4b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.163200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:53.190109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1007/2042] 10.222.0.39 () {58 vars in 967 bytes} [Wed Nov 2 07:43:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:53.202624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:53.204118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:53.285080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80caf0f-fcd3-46a7-b14c-56dee77c0246 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:53.290306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353f139-9ea8-4444-b3d2-108f98b5f3fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:53.291133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353f139-9ea8-4444-b3d2-108f98b5f3fe service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:53.294973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353f139-9ea8-4444-b3d2-108f98b5f3fe service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:53.294973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353f139-9ea8-4444-b3d2-108f98b5f3fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:53.300226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353f139-9ea8-4444-b3d2-108f98b5f3fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:53.301878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353f139-9ea8-4444-b3d2-108f98b5f3fe service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:53.310174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1036/2043] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:43:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:43:56.845206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc39e1-b5ff-4ee8-890f-b2e787c2e935 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.845682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc39e1-b5ff-4ee8-890f-b2e787c2e935 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.845793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc39e1-b5ff-4ee8-890f-b2e787c2e935 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.847185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1008/2044] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:43:56.862481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.862937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.869125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.872156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:56.884489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] MFA Rules not processed for user `c641dd28386e464cad2add5e42c5a518`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:56.885692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.948664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1037/2045] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:43:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:56.959478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc39e1-b5ff-4ee8-890f-b2e787c2e935 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:56.961227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-64cc39e1-b5ff-4ee8-890f-b2e787c2e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:56.977774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc39e1-b5ff-4ee8-890f-b2e787c2e935 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:56.983213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:56.983797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:56.984071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:56.984337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:56.992475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:56.993980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.003451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1009/2046] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:43:57.051885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.051885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:57.114413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15562e5-5011-4367-b38f-bf65cbb5205b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.119048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.119676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.119952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.120221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] PATH_INFO: `/v3/users/4d5bd861226244e0a3bd6a7ff5a041f5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.126791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5bd861226244e0a3bd6a7ff5a041f5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.126791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.356205 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5bd861226244e0a3bd6a7ff5a041f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.362982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5bd861226244e0a3bd6a7ff5a041f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.363648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5bd861226244e0a3bd6a7ff5a041f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.364246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5bd861226244e0a3bd6a7ff5a041f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.448919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1c2a48cc-2bc3-4e98-85ba-9eeda09a76c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5bd861226244e0a3bd6a7ff5a041f5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.470942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1038/2047] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:43:57 2022] DELETE /identity/v3/users/4d5bd861226244e0a3bd6a7ff5a041f5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:43:57.755793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:57.772893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67748d-6922-4b7c-96cc-e25e5c2b1186 service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:57.834285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:57.834910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:57.835189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:57.835460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] PATH_INFO: `/v3/projects/ab31dd16455443a5b0a05e30aab66418` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:57.836597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab31dd16455443a5b0a05e30aab66418)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:57.838492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:57.949915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab31dd16455443a5b0a05e30aab66418', 'request_id': 'req-8c59be64-a5fd-4c2d-8fb2-b30b81287999'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.957451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab31dd16455443a5b0a05e30aab66418', 'request_id': 'req-8c59be64-a5fd-4c2d-8fb2-b30b81287999'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:57.963256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab31dd16455443a5b0a05e30aab66418', 'request_id': 'req-8c59be64-a5fd-4c2d-8fb2-b30b81287999'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:58.094919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] The token cache is being invalidate because project ab31dd16455443a5b0a05e30aab66418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:43:58.095207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:58.105443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8c59be64-a5fd-4c2d-8fb2-b30b81287999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:43:58.105443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1010/2048] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:43:57 2022] DELETE /identity/v3/projects/ab31dd16455443a5b0a05e30aab66418 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:58.105655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d073d-2905-4664-ad85-ce3b4117e817 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.105655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d073d-2905-4664-ad85-ce3b4117e817 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.105655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d073d-2905-4664-ad85-ce3b4117e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.129189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-875d073d-2905-4664-ad85-ce3b4117e817 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:58.130583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-875d073d-2905-4664-ad85-ce3b4117e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:58.143529 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:58.190480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1039/2049] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:58.198130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f9a-fa3c-4bec-8124-c2c83602be12 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.198413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f9a-fa3c-4bec-8124-c2c83602be12 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.198704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b08f9a-fa3c-4bec-8124-c2c83602be12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.220474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e1b08f9a-fa3c-4bec-8124-c2c83602be12 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:58.221672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e1b08f9a-fa3c-4bec-8124-c2c83602be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:58.229511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1011/2050] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:58.234108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d073d-2905-4664-ad85-ce3b4117e817 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.243828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d073d-2905-4664-ad85-ce3b4117e817 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.248937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.249531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.249812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.250082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.250729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:43:58.251028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.252645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.264012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1040/2051] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:43:58.268294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b08f9a-fa3c-4bec-8124-c2c83602be12 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.277384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b08f9a-fa3c-4bec-8124-c2c83602be12 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.282515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.283107 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.283382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.283649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.284284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.286212 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.462216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1012/2052] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:43:58 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:43:58.466293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.476557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130218b7-7158-4104-a2d3-4974ff6352b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.534022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.534624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.534897 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.535163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.535792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.537736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.637595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1041/2053] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:43:58 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:43:58.641720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.651831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcf8cb-5cbd-4088-9ab8-3029fab61b9b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.657644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.658207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.658486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.658755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.659390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.661086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.674398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1013/2054] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:58.677191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.687776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5957581-274e-4cea-87c2-9249f13f7118 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.692415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70631e2e-cc8d-4747-9231-091037e45837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.693055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631e2e-cc8d-4747-9231-091037e45837 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.693312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631e2e-cc8d-4747-9231-091037e45837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.693582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70631e2e-cc8d-4747-9231-091037e45837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.694220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631e2e-cc8d-4747-9231-091037e45837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.695823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70631e2e-cc8d-4747-9231-091037e45837 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.707170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1042/2055] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:43:58.713723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.724074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b3a14-3308-4b1a-8d9b-a9746c5c1574 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:58.728681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:58.729320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.729597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.729864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] PATH_INFO: `/v3/projects/97d9bdd7db054d99af2d124952281264/users/00a0bb3fdc1a429999075c4b7c4d5cce/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.741557 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:43:58.744495 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d9bdd7db054d99af2d124952281264, user_id=00a0bb3fdc1a429999075c4b7c4d5cce, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:58.747129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:58.831641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1014/2056] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:43:58 2022] PUT /identity/v3/projects/97d9bdd7db054d99af2d124952281264/users/00a0bb3fdc1a429999075c4b7c4d5cce/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:43:58.843482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72050a-bc09-4ba4-8f1a-c1c662c38e1e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:58.843764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72050a-bc09-4ba4-8f1a-c1c662c38e1e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:58.844064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72050a-bc09-4ba4-8f1a-c1c662c38e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:58.871734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dc72050a-bc09-4ba4-8f1a-c1c662c38e1e None None] MFA Rules not processed for user `00a0bb3fdc1a429999075c4b7c4d5cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:43:58.872971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dc72050a-bc09-4ba4-8f1a-c1c662c38e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:58.935871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1043/2057] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:43:58.946486 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:43:58.948158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:43:59.004092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce47a-b2a2-4fde-86ae-4d8078752eb7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:43:59.007966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:43:59.008604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:43:59.008935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:43:59.009233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:43:59.018025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:43:59.019517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:43:59.028183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1015/2058] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:43:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:08.945294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:09.024198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:11.959319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6194a4-2777-4393-a4bc-644729dfe8df None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:11.959940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6194a4-2777-4393-a4bc-644729dfe8df None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:11.959940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6194a4-2777-4393-a4bc-644729dfe8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:11.980542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8d6194a4-2777-4393-a4bc-644729dfe8df None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:11.982346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8d6194a4-2777-4393-a4bc-644729dfe8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.050482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1044/2059] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:12.078852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:12.080323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:12.154100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c521e5-6222-4aa8-85df-eb4c557230d3 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:12.159762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbf3b8-cb67-49dc-a12b-d0f629ddc19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:12.168595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf3b8-cb67-49dc-a12b-d0f629ddc19c service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:12.168595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf3b8-cb67-49dc-a12b-d0f629ddc19c service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:12.168595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf3b8-cb67-49dc-a12b-d0f629ddc19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:12.169963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbf3b8-cb67-49dc-a12b-d0f629ddc19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:12.171518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbf3b8-cb67-49dc-a12b-d0f629ddc19c service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:12.180688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1016/2060] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:15.316253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6194a4-2777-4393-a4bc-644729dfe8df None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:15.326504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6194a4-2777-4393-a4bc-644729dfe8df None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:15.330996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:15.331637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:15.331911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:15.332183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] PATH_INFO: `/v3/users/00a0bb3fdc1a429999075c4b7c4d5cce` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:15.334540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a0bb3fdc1a429999075c4b7c4d5cce)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:15.335250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:15.619681 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a0bb3fdc1a429999075c4b7c4d5cce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:15.627671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a0bb3fdc1a429999075c4b7c4d5cce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:15.628361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a0bb3fdc1a429999075c4b7c4d5cce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:15.629017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a0bb3fdc1a429999075c4b7c4d5cce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:15.756957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a0bb3fdc1a429999075c4b7c4d5cce'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:15.776198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1045/2061] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:44:15 2022] DELETE /identity/v3/users/00a0bb3fdc1a429999075c4b7c4d5cce => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:15.780904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:15.781383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:15.781489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:15.799863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:15.801371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:15.863893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1017/2062] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:15.873973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:15.875471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:15.947101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a057b-2a76-48e8-b942-e2a09c7e3247 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:15.951227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d5ff8-3b65-4b2e-a550-88379259dec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:15.951871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d5ff8-3b65-4b2e-a550-88379259dec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:15.952147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d5ff8-3b65-4b2e-a550-88379259dec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:15.952415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d5ff8-3b65-4b2e-a550-88379259dec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:15.961286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d5ff8-3b65-4b2e-a550-88379259dec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:15.962722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d5ff8-3b65-4b2e-a550-88379259dec1 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:15.972307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1046/2063] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:16.507572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:16.509191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:16.522833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfb146-d302-4a75-8bf4-076dec327fb6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:16.529039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:16.529901 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:16.530408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:16.530678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] PATH_INFO: `/v3/projects/97d9bdd7db054d99af2d124952281264` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:16.531876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d9bdd7db054d99af2d124952281264)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:16.533951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:16.655052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d9bdd7db054d99af2d124952281264', 'request_id': 'req-b483d601-eb53-4fd3-8767-118f31fda3b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:16.661375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d9bdd7db054d99af2d124952281264', 'request_id': 'req-b483d601-eb53-4fd3-8767-118f31fda3b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:16.666962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d9bdd7db054d99af2d124952281264', 'request_id': 'req-b483d601-eb53-4fd3-8767-118f31fda3b8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:16.787382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] The token cache is being invalidate because project 97d9bdd7db054d99af2d124952281264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:44:16.787986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:16.788489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:44:16.789992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1018/2064] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:44:16 2022] DELETE /identity/v3/projects/97d9bdd7db054d99af2d124952281264 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:44:19.716102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5f1d6-29f6-425b-8f6f-e95fece46425 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:19.716559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5f1d6-29f6-425b-8f6f-e95fece46425 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:19.716559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5f1d6-29f6-425b-8f6f-e95fece46425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:19.737799 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cbe5f1d6-29f6-425b-8f6f-e95fece46425 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:19.742549 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cbe5f1d6-29f6-425b-8f6f-e95fece46425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:19.749748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:19.799980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1047/2065] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:19.822058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:19.823476 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:19.835215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:19.896414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d601-eb53-4fd3-8767-118f31fda3b8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:19.901781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:19.902381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:19.902658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:19.902932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:19.911084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:19.913374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:19.922321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1019/2066] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:25.321786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4fc1-631b-4cd5-94c1-10188dfb19dd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:25.322289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4fc1-631b-4cd5-94c1-10188dfb19dd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:25.322389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d4fc1-631b-4cd5-94c1-10188dfb19dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:25.342192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9c5d4fc1-631b-4cd5-94c1-10188dfb19dd None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:25.343375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9c5d4fc1-631b-4cd5-94c1-10188dfb19dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:25.351251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1048/2067] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:25.371982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:25.373354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:25.387786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149b32a-1b84-4a39-87ca-f844313b5223 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:25.393136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:25.393719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:25.393994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:25.394288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:25.402238 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:25.404591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:25.413643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1020/2068] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:29.203026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910456ac-6485-4b18-939d-691f8e53b4ab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.203400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910456ac-6485-4b18-939d-691f8e53b4ab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.210517 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910456ac-6485-4b18-939d-691f8e53b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.223301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-910456ac-6485-4b18-939d-691f8e53b4ab None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:29.224525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-910456ac-6485-4b18-939d-691f8e53b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:29.232332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1049/2069] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:29.263659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:29.277245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675571d-a0f9-4856-8a16-96f3de452d41 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:29.283127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:29.283720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:29.283994 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:29.284264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:29.292296 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:29.294463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:29.303566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1021/2070] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:34.570786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec14a-6dd7-4686-85d5-88c9efed786d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:34.571301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec14a-6dd7-4686-85d5-88c9efed786d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:34.571429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec14a-6dd7-4686-85d5-88c9efed786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:34.590840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-29aec14a-6dd7-4686-85d5-88c9efed786d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:34.592049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-29aec14a-6dd7-4686-85d5-88c9efed786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:34.600704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1050/2071] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:34.622777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:34.635119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0c6a0-4b88-42d8-ac8f-98a9ecd1f452 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:34.641755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:34.642373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:34.642652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:34.642922 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:34.651433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:34.653070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:34.663361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1022/2072] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:40.943356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd92f0-ddf7-4b0e-a673-caed959a0512 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:40.943872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd92f0-ddf7-4b0e-a673-caed959a0512 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:40.944422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd92f0-ddf7-4b0e-a673-caed959a0512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:40.966438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-69bd92f0-ddf7-4b0e-a673-caed959a0512 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:40.967670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-69bd92f0-ddf7-4b0e-a673-caed959a0512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:40.975918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1051/2073] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:40.996886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.008487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbc973-f1da-4991-8f00-d7a7eec8c5e0 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.014083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.014659 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.014944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.015224 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.023660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.025432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:41.036605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1023/2074] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:44:41.349811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.350100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.350377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.369647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:44:41.370827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.424851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1052/2075] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:44:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:44:41.447902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:41.449336 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:41.517732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc7c07-e544-4c9a-a36e-84fd857318cb service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:41.522640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01e484-7e47-455b-9e36-571943341e91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:41.523270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01e484-7e47-455b-9e36-571943341e91 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:41.523542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01e484-7e47-455b-9e36-571943341e91 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:41.523804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01e484-7e47-455b-9e36-571943341e91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:41.533468 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01e484-7e47-455b-9e36-571943341e91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:41.535026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01e484-7e47-455b-9e36-571943341e91 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:41.542825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1024/2076] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:44:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:44:51.418387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=57 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:51.541879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=86 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:44:59.235184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:44:59.236590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:59.304851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b205f-7329-412d-9b07-7bd17fc421d5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:44:59.309731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e549e78-2b65-4267-8494-696c27e67efb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:44:59.310352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e549e78-2b65-4267-8494-696c27e67efb service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:44:59.310624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e549e78-2b65-4267-8494-696c27e67efb service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:44:59.310887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e549e78-2b65-4267-8494-696c27e67efb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:44:59.312615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4e549e78-2b65-4267-8494-696c27e67efb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:44:59.323601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e549e78-2b65-4267-8494-696c27e67efb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:44:59.325215 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e549e78-2b65-4267-8494-696c27e67efb service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:44:59.334739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1053/2077] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:44:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:02.100091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4e64-ab6b-4fd8-b482-f39ce31c41b9 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.100595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4e64-ab6b-4fd8-b482-f39ce31c41b9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.101208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4e64-ab6b-4fd8-b482-f39ce31c41b9 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.102012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1025/2078] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:45:02.107937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79093-e471-4859-9d8c-c7bcf0cd9346 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.108416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79093-e471-4859-9d8c-c7bcf0cd9346 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.108535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d79093-e471-4859-9d8c-c7bcf0cd9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.139447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-06d79093-e471-4859-9d8c-c7bcf0cd9346 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:02.140750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-06d79093-e471-4859-9d8c-c7bcf0cd9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:02.149909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1054/2079] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:45:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:02.163409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4e64-ab6b-4fd8-b482-f39ce31c41b9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:02.165472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-266c4e64-ab6b-4fd8-b482-f39ce31c41b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:02.223418 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4e64-ab6b-4fd8-b482-f39ce31c41b9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:02.226937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dec0a-f40f-43b8-bc6b-32988f1a148b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:02.227531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dec0a-f40f-43b8-bc6b-32988f1a148b service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.227809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dec0a-f40f-43b8-bc6b-32988f1a148b service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.228078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dec0a-f40f-43b8-bc6b-32988f1a148b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.238928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dec0a-f40f-43b8-bc6b-32988f1a148b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:02.240350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dec0a-f40f-43b8-bc6b-32988f1a148b service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:02.250779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1026/2080] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:02.580000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd164e-9861-4fa6-b83e-9d46fde68402 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.580318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd164e-9861-4fa6-b83e-9d46fde68402 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.580652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd164e-9861-4fa6-b83e-9d46fde68402 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.582033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1055/2081] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 07:45:02.586922 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26971-9f22-4a39-8845-19478e861362 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.587211 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26971-9f22-4a39-8845-19478e861362 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.587481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26971-9f22-4a39-8845-19478e861362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.608423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-00c26971-9f22-4a39-8845-19478e861362 None None] MFA Rules not processed for user `60e4cc87886d4b7788864eaf94334e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:02.609643 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-00c26971-9f22-4a39-8845-19478e861362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:02.662119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1027/2082] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:45:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:02.673847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd164e-9861-4fa6-b83e-9d46fde68402 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:02.675537 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47fd164e-9861-4fa6-b83e-9d46fde68402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:02.688815 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd164e-9861-4fa6-b83e-9d46fde68402 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:02.692337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec497bd6-2870-481e-bb7f-3f544fb6aec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:02.692960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497bd6-2870-481e-bb7f-3f544fb6aec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.693240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497bd6-2870-481e-bb7f-3f544fb6aec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.693514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec497bd6-2870-481e-bb7f-3f544fb6aec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.700419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497bd6-2870-481e-bb7f-3f544fb6aec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:02.701865 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec497bd6-2870-481e-bb7f-3f544fb6aec6 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:02.710031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1056/2083] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:02.791510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ceca3-015f-4200-81bf-45f1640cda2e None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.795854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ceca3-015f-4200-81bf-45f1640cda2e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.795854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ceca3-015f-4200-81bf-45f1640cda2e None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.795854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1028/2084] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:45:02.798975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1045-a71a-497e-bff1-15db23168ece None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.799280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1045-a71a-497e-bff1-15db23168ece None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.799577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a1045-a71a-497e-bff1-15db23168ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.820568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b18a1045-a71a-497e-bff1-15db23168ece None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:02.821790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b18a1045-a71a-497e-bff1-15db23168ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:02.831672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1057/2085] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:45:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:02.843161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ceca3-015f-4200-81bf-45f1640cda2e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:02.854763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ceca3-015f-4200-81bf-45f1640cda2e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:02.858380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b19894-0109-40bf-a402-add75610d8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:02.858966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b19894-0109-40bf-a402-add75610d8be service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:02.859239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b19894-0109-40bf-a402-add75610d8be service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:02.859507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b19894-0109-40bf-a402-add75610d8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:02.869648 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b19894-0109-40bf-a402-add75610d8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:02.871067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b19894-0109-40bf-a402-add75610d8be service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:02.882622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1029/2086] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:06.739111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40f77-e5b2-4385-a0cb-3c4912fde934 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:06.739667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40f77-e5b2-4385-a0cb-3c4912fde934 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:06.739800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce40f77-e5b2-4385-a0cb-3c4912fde934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:06.760783 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7ce40f77-e5b2-4385-a0cb-3c4912fde934 None None] MFA Rules not processed for user `b1bf95567dc046dc954fd36ab8a270be`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:06.762138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7ce40f77-e5b2-4385-a0cb-3c4912fde934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:06.823595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1058/2087] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:45:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:07.463589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d106-5b21-4904-90a7-a257255e9a25 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:07.464059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d106-5b21-4904-90a7-a257255e9a25 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:07.464153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45d106-5b21-4904-90a7-a257255e9a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:07.482980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ca45d106-5b21-4904-90a7-a257255e9a25 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:07.484201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ca45d106-5b21-4904-90a7-a257255e9a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:07.491701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1030/2088] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:45:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:07.504076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40f77-e5b2-4385-a0cb-3c4912fde934 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:07.516578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce40f77-e5b2-4385-a0cb-3c4912fde934 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:07.521523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:07.522107 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:07.522383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:07.522646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:07.533654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:07.533654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:07.546213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1059/2089] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:45:17.478103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=58 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:17.542170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=75 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:34.382622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201149-b015-4ed7-bd08-a6f7cd95c976 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:34.383122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201149-b015-4ed7-bd08-a6f7cd95c976 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:34.383218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201149-b015-4ed7-bd08-a6f7cd95c976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:34.402575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-31201149-b015-4ed7-bd08-a6f7cd95c976 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:34.405547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-31201149-b015-4ed7-bd08-a6f7cd95c976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:34.410953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1031/2090] 10.222.0.39 () {58 vars in 967 bytes} [Wed Nov 2 07:45:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:34.423285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:34.434904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d728e-f258-4841-a56e-8f3495b5c453 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:34.440008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:34.440642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:34.447493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:34.447493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:34.450310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:34.451890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:34.460332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1060/2091] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:45:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:45:44.397113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:44.456862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:45:45.761330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d068-237f-41db-b363-a88b3233529d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:45.761889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d068-237f-41db-b363-a88b3233529d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:45.761889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d068-237f-41db-b363-a88b3233529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:45.781180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-32b4d068-237f-41db-b363-a88b3233529d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:45.782365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-32b4d068-237f-41db-b363-a88b3233529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:45.790076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1032/2092] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:45.811147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:45.823569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caf03a-e828-4d4d-a75e-756f1956f317 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:45.829065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8368e7-af29-4814-9865-748add826efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:45.829691 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8368e7-af29-4814-9865-748add826efc service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:45.829980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8368e7-af29-4814-9865-748add826efc service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:45.830272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8368e7-af29-4814-9865-748add826efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:45.838498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8368e7-af29-4814-9865-748add826efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:45.840115 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8368e7-af29-4814-9865-748add826efc service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:45.850003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1061/2093] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:50.070586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96457f-1c13-4ab0-8d5b-6be423a536b2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.071281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96457f-1c13-4ab0-8d5b-6be423a536b2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.071281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96457f-1c13-4ab0-8d5b-6be423a536b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.090089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dd96457f-1c13-4ab0-8d5b-6be423a536b2 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:50.091257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dd96457f-1c13-4ab0-8d5b-6be423a536b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:50.098902 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1033/2094] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:50.121386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8368e7-af29-4814-9865-748add826efc service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:50.133174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8368e7-af29-4814-9865-748add826efc service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:50.138575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:50.139158 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:50.139432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:50.139711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:50.147644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:50.149252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:50.158696 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1062/2095] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:45:54.069403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdfb71-40e9-4254-ab8d-b334449e2780 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.069916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdfb71-40e9-4254-ab8d-b334449e2780 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.070032 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdfb71-40e9-4254-ab8d-b334449e2780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.089489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fbcdfb71-40e9-4254-ab8d-b334449e2780 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:45:54.090665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fbcdfb71-40e9-4254-ab8d-b334449e2780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:45:54.098971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1034/2096] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:45:54.125079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:45:54.136023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b33a-dcd7-4f64-998c-927adf7b2f05 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:45:54.141476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72560b4d-8359-4283-9b72-bbe513226284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:45:54.142059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560b4d-8359-4283-9b72-bbe513226284 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:45:54.142523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560b4d-8359-4283-9b72-bbe513226284 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:45:54.142795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72560b4d-8359-4283-9b72-bbe513226284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:45:54.150978 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560b4d-8359-4283-9b72-bbe513226284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:45:54.152720 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72560b4d-8359-4283-9b72-bbe513226284 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:45:54.163036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1063/2097] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:00.360340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1b5b-8904-46b8-9cfc-156cbb617b9a None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:00.360900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1b5b-8904-46b8-9cfc-156cbb617b9a None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:00.360900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1b5b-8904-46b8-9cfc-156cbb617b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:00.379990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2a7e1b5b-8904-46b8-9cfc-156cbb617b9a None None] MFA Rules not processed for user `6db9f53e5e204abfb8f89a041b8c26a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:00.381181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2a7e1b5b-8904-46b8-9cfc-156cbb617b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:00.436016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1035/2098] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:46:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:01.426014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f7ef-d38d-48f9-8990-ee0d6e094d23 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:01.426528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f7ef-d38d-48f9-8990-ee0d6e094d23 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:01.426528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7f7ef-d38d-48f9-8990-ee0d6e094d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:01.446582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0ff7f7ef-d38d-48f9-8990-ee0d6e094d23 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:01.447823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0ff7f7ef-d38d-48f9-8990-ee0d6e094d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:01.456185 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1064/2099] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:46:01.477065 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1b5b-8904-46b8-9cfc-156cbb617b9a None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:01.490307 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1b5b-8904-46b8-9cfc-156cbb617b9a None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:01.495705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b629a2-6c80-488a-9ba1-1995e1f27673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:01.496323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b629a2-6c80-488a-9ba1-1995e1f27673 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:01.496634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b629a2-6c80-488a-9ba1-1995e1f27673 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:01.496904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b629a2-6c80-488a-9ba1-1995e1f27673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:01.505689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b629a2-6c80-488a-9ba1-1995e1f27673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:01.507267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b629a2-6c80-488a-9ba1-1995e1f27673 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:01.516874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1036/2100] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:05.603136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7f7ef-d38d-48f9-8990-ee0d6e094d23 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:05.612927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7f7ef-d38d-48f9-8990-ee0d6e094d23 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:05.617392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:05.617989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:05.618262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:05.618531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:05.620278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:05.634288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:05.653622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:05.653622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1065/2101] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:08.810373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:08.810857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:08.810954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:08.829872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:08.831046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:08.839209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1037/2102] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Nov 2 07:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:08.861086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:08.872060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569452a1-7d0a-49bb-9a54-6415d9e3b790 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:08.877454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:08.878029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:08.878302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:08.878568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:08.886672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:08.888206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:08.897879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1066/2103] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:11.472658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:11.474058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:11.486156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316396-65b5-463e-9f23-c0bd1803f967 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:11.489739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:11.490339 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:11.491130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:11.491399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:11.493161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:11.507147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:11.508613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:11.519773 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1038/2104] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:18.893393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=33 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:20.833231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:20.844446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232518f-2fef-4843-98a3-a8adaccd2bb5 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:20.850356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:20.850940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:20.851233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:20.851483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:20.853217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:20.910940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:20.913031 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:20.922431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1067/2105] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:21.515472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=49 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:30.917954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=28 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:43.336197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:43.347709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003d39-f522-40fd-91df-02ab694dba13 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:43.353770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:43.354364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:43.354642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:43.354912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:43.356815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:43.418098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:43.419730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:43.429300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1039/2106] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:46.796209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:46.797998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:46.813486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6466d-a13e-47e0-ae06-62ef8bed8d98 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:46.818184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:46.818768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:46.819060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:46.819351 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] PATH_INFO: `/v3/users/b1bf95567dc046dc954fd36ab8a270be` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:46.820467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bf95567dc046dc954fd36ab8a270be)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:46.823058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:47.052794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bf95567dc046dc954fd36ab8a270be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.060323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bf95567dc046dc954fd36ab8a270be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.061007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bf95567dc046dc954fd36ab8a270be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.061602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bf95567dc046dc954fd36ab8a270be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.141531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-028a97e8-d081-4bbe-bf66-1ba36e3fe2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bf95567dc046dc954fd36ab8a270be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.160057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1068/2107] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:46:46 2022] DELETE /identity/v3/users/b1bf95567dc046dc954fd36ab8a270be => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:47.451934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:47.463427 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b65d-b79f-4347-9f11-c57491d8bda9 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:47.526829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:47.527470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:47.527779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:47.528047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] PATH_INFO: `/v3/projects/598eb929657c43d7b4a19bbdb03f2457` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:47.529189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] RBAC: Authorizing `identity:delete_project(project_id=598eb929657c43d7b4a19bbdb03f2457)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:47.531081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:47.638201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598eb929657c43d7b4a19bbdb03f2457', 'request_id': 'req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.644527 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598eb929657c43d7b4a19bbdb03f2457', 'request_id': 'req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.650528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598eb929657c43d7b4a19bbdb03f2457', 'request_id': 'req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.740622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] The token cache is being invalidate because project 598eb929657c43d7b4a19bbdb03f2457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:46:47.740842 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.741457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ed07ae32-2b68-4385-8a83-4a8c1b8e766b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:46:47.742956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1040/2108] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:46:47 2022] DELETE /identity/v3/projects/598eb929657c43d7b4a19bbdb03f2457 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:47.747831 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2438b3-d5ac-4bca-a7ba-bc2976fd60fe None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:47.751926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2438b3-d5ac-4bca-a7ba-bc2976fd60fe None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:47.751926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2438b3-d5ac-4bca-a7ba-bc2976fd60fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:47.769131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5a2438b3-d5ac-4bca-a7ba-bc2976fd60fe None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:47.770314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5a2438b3-d5ac-4bca-a7ba-bc2976fd60fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:47.829676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1069/2109] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:47.837443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804079-fbbd-4bf5-a128-46e92fdab99e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:47.838412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804079-fbbd-4bf5-a128-46e92fdab99e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:47.838699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39804079-fbbd-4bf5-a128-46e92fdab99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:47.859252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-39804079-fbbd-4bf5-a128-46e92fdab99e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:47.860483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-39804079-fbbd-4bf5-a128-46e92fdab99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:47.869222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1041/2110] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:47.873434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2438b3-d5ac-4bca-a7ba-bc2976fd60fe None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:47.883229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2438b3-d5ac-4bca-a7ba-bc2976fd60fe None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:47.888336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:47.888970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:47.889247 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:47.889516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:47.890189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:46:47.890487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:47.892113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:47.904631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1070/2111] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:46:47.909133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39804079-fbbd-4bf5-a128-46e92fdab99e None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:47.918451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39804079-fbbd-4bf5-a128-46e92fdab99e None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:47.923059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:47.923644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:47.923917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:47.924180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:47.924963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:47.926825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.020782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:48.026935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1042/2112] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:46:47 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:46:48.031052 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:48.041422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97dc8b-0dbb-44e1-9874-4bd10cff09fa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:48.096920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:48.097505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:48.097780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:48.098045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:48.098670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:48.100630 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.108619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:46:48.164881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1071/2113] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:46:48 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:46:48.169473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:48.179725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a8017-5841-4970-a292-6ed14bb2a58f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:48.184281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:48.184897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:48.185176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:48.185446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:48.186079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:48.187663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.197916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1043/2114] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:46:48.201771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:48.211821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40954a47-8d51-45e8-a83c-68cf63f4d829 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:48.217026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe010fd0-f98b-4836-9ae4-5fe6517d95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:48.217610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010fd0-f98b-4836-9ae4-5fe6517d95e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:48.217886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010fd0-f98b-4836-9ae4-5fe6517d95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:48.218156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010fd0-f98b-4836-9ae4-5fe6517d95e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:48.218815 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe010fd0-f98b-4836-9ae4-5fe6517d95e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:48.220395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe010fd0-f98b-4836-9ae4-5fe6517d95e1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.232104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1072/2115] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:46:48.235945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:48.245844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86091f83-f628-4793-9a49-43904b9d9aa8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:48.250509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:48.251147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:48.251424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:48.251691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] PATH_INFO: `/v3/projects/9bde155cc21d4196bf2dcf9c3257df3c/users/870a060107c64e83b6c13987e5d5f2ca/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:48.266333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bde155cc21d4196bf2dcf9c3257df3c, user_id=870a060107c64e83b6c13987e5d5f2ca, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:48.269001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.347466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1044/2116] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:46:48 2022] PUT /identity/v3/projects/9bde155cc21d4196bf2dcf9c3257df3c/users/870a060107c64e83b6c13987e5d5f2ca/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:46:48.358993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63b83-6617-46f0-92cb-1411d780e633 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:48.359328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63b83-6617-46f0-92cb-1411d780e633 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:48.359602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63b83-6617-46f0-92cb-1411d780e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:48.387654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9fb63b83-6617-46f0-92cb-1411d780e633 None None] MFA Rules not processed for user `870a060107c64e83b6c13987e5d5f2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:48.388951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9fb63b83-6617-46f0-92cb-1411d780e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:48.453139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1073/2117] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:46:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:46:48.464562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:48.466354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:48.521542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d764f7-59d2-49d9-9304-c652f603b57e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:48.525806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:48.526400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:48.526678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:48.526942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:48.535314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:48.536769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:48.545335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1045/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:55.975959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:55.976512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:55.976512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:55.997845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] MFA Rules not processed for user `86f173866b014ce69c82c6c2eed4c719`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:46:55.999727 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:56.059093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1074/2119] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:46:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:46:56.365033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:56.366405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:56.422760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7cf88-60bb-4561-b91e-cd05b3888aae service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:56.426360 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:56.426953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:56.427237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:56.427508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:56.429245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:56.438492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:56.439900 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:56.447971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1046/2120] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:46:56.849816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:46:56.851207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:56.928449 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028e26-3896-4615-8ef4-e2f0472b734f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:46:56.933507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:46:56.934101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:46:56.934420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:46:56.934723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:46:56.936447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:46:56.947647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:46:56.949361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:46:56.959141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1075/2121] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:46:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:00.678453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:00.687131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ae638-319c-405a-8a4e-46871c842278 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:00.691248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:00.691830 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:00.692111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:00.692382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:00.694209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:00.705402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:00.706832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:00.715186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1047/2122] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:01.519731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:01.521183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:01.526056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:01.594051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eafbc6-e648-4bb9-9d33-d99e172c4f8c service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:01.599971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756eae6-3359-43fb-9400-013d5592f8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:01.601736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756eae6-3359-43fb-9400-013d5592f8ca service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:01.601736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756eae6-3359-43fb-9400-013d5592f8ca service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:01.601736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756eae6-3359-43fb-9400-013d5592f8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:01.602908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f756eae6-3359-43fb-9400-013d5592f8ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:01.615399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756eae6-3359-43fb-9400-013d5592f8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:01.617018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756eae6-3359-43fb-9400-013d5592f8ca service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:01.627159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1076/2123] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:02.777520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:02.834241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:02.838246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1f177-737b-4206-992e-7cab97a6b8c5 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:02.842668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:02.843274 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:02.852122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:02.852122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] PATH_INFO: `/v3/users/870a060107c64e83b6c13987e5d5f2ca` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:02.852122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870a060107c64e83b6c13987e5d5f2ca)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:02.852122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.138511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870a060107c64e83b6c13987e5d5f2ca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:03.139150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870a060107c64e83b6c13987e5d5f2ca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:03.151533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870a060107c64e83b6c13987e5d5f2ca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:03.158542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870a060107c64e83b6c13987e5d5f2ca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:03.244316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870a060107c64e83b6c13987e5d5f2ca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:03.250237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1048/2124] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:02 2022] DELETE /identity/v3/users/870a060107c64e83b6c13987e5d5f2ca => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:03.254664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.255136 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.255245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.274561 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:03.275740 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.333315 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1077/2125] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:03.342760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.344119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.400505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e967a3-a459-4804-b29e-2b43c5d01cd6 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.403885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.404499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.404776 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.405067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.414441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.415852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:03.424896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1049/2126] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:03.932421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:03.933850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:03.946997 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47efe47-a1fc-476d-a38e-5e1418199b60 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:03.951706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:03.952331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:03.952645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:03.952922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] PATH_INFO: `/v3/projects/9bde155cc21d4196bf2dcf9c3257df3c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:03.954033 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bde155cc21d4196bf2dcf9c3257df3c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:03.955965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:04.084592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bde155cc21d4196bf2dcf9c3257df3c', 'request_id': 'req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:04.090224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bde155cc21d4196bf2dcf9c3257df3c', 'request_id': 'req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:04.096622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bde155cc21d4196bf2dcf9c3257df3c', 'request_id': 'req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:04.193036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] The token cache is being invalidate because project 9bde155cc21d4196bf2dcf9c3257df3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:04.193253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:04.193860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:04.195440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1078/2127] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:03 2022] DELETE /identity/v3/projects/9bde155cc21d4196bf2dcf9c3257df3c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:07.960137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:07.961349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:08.033973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737a63c-512f-4c52-b575-077d9bb34043 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:08.046124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:08.098165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:08.098780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:08.099053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:08.099317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:08.101034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:08.112919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:08.114494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:08.127119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1050/2128] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:47:11.968020 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:11.969605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:11.987258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484c526-9e10-4fa5-9ffd-cccbaf8b6f7b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:11.994140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:11.994874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:12.001669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:12.001669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:12.001669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:12.009434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:12.010998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:12.015669 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:12.022181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1079/2129] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:13.587951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:13.589475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:13.645429 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9ffa7-3971-4221-a676-cb46af911f7d service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:13.649547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90956a2-d28b-49d2-9495-4a90cd9b1c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:13.650132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90956a2-d28b-49d2-9495-4a90cd9b1c9a service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:13.650412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90956a2-d28b-49d2-9495-4a90cd9b1c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:13.650684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90956a2-d28b-49d2-9495-4a90cd9b1c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:13.652401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b90956a2-d28b-49d2-9495-4a90cd9b1c9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:13.710056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90956a2-d28b-49d2-9495-4a90cd9b1c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:13.711481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90956a2-d28b-49d2-9495-4a90cd9b1c9a service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:13.720330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1051/2130] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:22.113064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:23.716155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=74 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:37.060878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:37.062313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:37.187620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1d487-a087-4858-ae02-ddc5c2505fd6 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:37.191325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:37.191912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:37.192190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:37.193056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:37.194781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:37.304073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:37.305479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:37.325568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1080/2131] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:41.377424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:41.377905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:41.378156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:41.399025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] MFA Rules not processed for user `207560d0ab0b4fe0bae750ac180f37bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:41.400132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:41.463828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1052/2132] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:41.928279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:41.936514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71866-ea83-4f19-aca5-ef3ba86522d8 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:41.940520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:41.941148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:41.941420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:41.941686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:41.943442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:41.953783 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:41.955195 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:41.960122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:41.964210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1081/2133] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:42.105465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:42.106985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:42.120541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4440e8-836b-4a88-9218-f54691f1869b None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:42.127882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:42.128557 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:42.128832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:42.129098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] PATH_INFO: `/v3/users/6db9f53e5e204abfb8f89a041b8c26a9` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:42.130253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db9f53e5e204abfb8f89a041b8c26a9)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:42.132200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:42.349398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db9f53e5e204abfb8f89a041b8c26a9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:42.350111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db9f53e5e204abfb8f89a041b8c26a9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:42.361991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db9f53e5e204abfb8f89a041b8c26a9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:42.368908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db9f53e5e204abfb8f89a041b8c26a9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:42.455585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0140bff7-3f48-4541-b94d-3705e11c002b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db9f53e5e204abfb8f89a041b8c26a9'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:42.462882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1053/2134] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:42 2022] DELETE /identity/v3/users/6db9f53e5e204abfb8f89a041b8c26a9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:42.720531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:42.735058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486154a7-fd61-49a2-914d-9555da054369 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:42.799916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:42.800585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:42.800939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:42.801219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] PATH_INFO: `/v3/projects/3312b317832c42c9b0a097fd4c3c0498` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:42.802890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3312b317832c42c9b0a097fd4c3c0498)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:42.805849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:42.941570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3312b317832c42c9b0a097fd4c3c0498', 'request_id': 'req-1af8119e-0eec-4815-aaea-723e439ff826'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:42.947821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3312b317832c42c9b0a097fd4c3c0498', 'request_id': 'req-1af8119e-0eec-4815-aaea-723e439ff826'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:42.954141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3312b317832c42c9b0a097fd4c3c0498', 'request_id': 'req-1af8119e-0eec-4815-aaea-723e439ff826'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:43.036545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] The token cache is being invalidate because project 3312b317832c42c9b0a097fd4c3c0498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:43.036769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:43.037385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1af8119e-0eec-4815-aaea-723e439ff826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:43.038852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1082/2135] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:42 2022] DELETE /identity/v3/projects/3312b317832c42c9b0a097fd4c3c0498 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:43.043710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042775-465d-4754-99b3-b06e2a1b9cd0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.044036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042775-465d-4754-99b3-b06e2a1b9cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.044309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042775-465d-4754-99b3-b06e2a1b9cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.100844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-97042775-465d-4754-99b3-b06e2a1b9cd0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:43.102048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-97042775-465d-4754-99b3-b06e2a1b9cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:43.145561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:43.163184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1054/2136] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:43.171026 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575b98-903b-446a-b449-48c2ff9e6c60 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.173491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575b98-903b-446a-b449-48c2ff9e6c60 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.173491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32575b98-903b-446a-b449-48c2ff9e6c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.191433 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-32575b98-903b-446a-b449-48c2ff9e6c60 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:43.192694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-32575b98-903b-446a-b449-48c2ff9e6c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:43.200630 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1083/2137] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:47:43.205766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042775-465d-4754-99b3-b06e2a1b9cd0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:43.213986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042775-465d-4754-99b3-b06e2a1b9cd0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:43.218547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:43.219126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.219405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.219687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.220309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:43.220645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:43.222229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:43.234823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1055/2138] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:43.239005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32575b98-903b-446a-b449-48c2ff9e6c60 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:43.248524 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32575b98-903b-446a-b449-48c2ff9e6c60 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:43.253167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:43.253750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.254028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.254298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.254951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:43.256892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:43.363653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1084/2139] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:43 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:43.368299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:43.378128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a004-6f18-4f81-8be9-b88bb1ec8067 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:43.442752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:43.443385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.443663 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.443929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.444591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:43.446500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:43.565049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1056/2140] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:43 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:43.569210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:43.579343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b125789-d673-4b97-bc74-aae265c1d104 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:43.584346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:43.584973 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.585251 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.585518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.586150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:43.587737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:43.597464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1085/2141] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:43.601847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:43.611647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d2be4-4a00-44bc-bcae-024dacb243e1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:43.616369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f4ace-ba47-486d-89e0-62ef644fb06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:43.616907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f4ace-ba47-486d-89e0-62ef644fb06b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.617187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f4ace-ba47-486d-89e0-62ef644fb06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.617455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f4ace-ba47-486d-89e0-62ef644fb06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.618085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f4ace-ba47-486d-89e0-62ef644fb06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:43.619665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f4ace-ba47-486d-89e0-62ef644fb06b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:43.630164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1057/2142] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:43.634075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:43.643693 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0eb3d-f747-46ab-b650-d52daa51d649 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:43.648711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:43.649338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.649615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.649885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] PATH_INFO: `/v3/projects/da367b1e694a4a22b5b95d49cf11047b/users/409fe672fb4d4b50b9f2922feac69eac/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.665214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=da367b1e694a4a22b5b95d49cf11047b, user_id=409fe672fb4d4b50b9f2922feac69eac, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:43.667837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:43.758700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1086/2143] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:43 2022] PUT /identity/v3/projects/da367b1e694a4a22b5b95d49cf11047b/users/409fe672fb4d4b50b9f2922feac69eac/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:43.770029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea44de2-216c-43c0-a64c-783053388fa1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.770312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea44de2-216c-43c0-a64c-783053388fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.770590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea44de2-216c-43c0-a64c-783053388fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.799446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bea44de2-216c-43c0-a64c-783053388fa1 None None] MFA Rules not processed for user `409fe672fb4d4b50b9f2922feac69eac`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:43.800675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bea44de2-216c-43c0-a64c-783053388fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:43.862791 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1058/2144] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:47:43.867308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:43.886544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:43.928418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6941c5-1124-479d-b39a-37830e54f3ef admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:43.933043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:43.933637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:43.933912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:43.934180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:43.934810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:43.936719 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.016690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1087/2145] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:43 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:44.020813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea44de2-216c-43c0-a64c-783053388fa1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:44.031781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea44de2-216c-43c0-a64c-783053388fa1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:44.071512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:44.087406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:44.087997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.088275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.088576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.089204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:44.091113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.187181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1059/2146] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:44 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:47:44.191387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:44.202363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592c0b-6cf4-4e40-b472-0d17ed01ad0f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:44.206923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:44.207530 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.207803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.208061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.209385 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:44.211017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.221633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1088/2147] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:44.226037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:44.235679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd073cd-7ffe-4ebe-a968-0feb09d3945b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:44.240811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:44.241442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.241719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.241990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] PATH_INFO: `/v3/projects/96fcc8a7552f44658f37d3e2a86fe9f8/users/68d49a99463f48fba9c355446b3ff59b/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.257641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fcc8a7552f44658f37d3e2a86fe9f8, user_id=68d49a99463f48fba9c355446b3ff59b, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:44.260344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.370140 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1060/2148] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:44 2022] PUT /identity/v3/projects/96fcc8a7552f44658f37d3e2a86fe9f8/users/68d49a99463f48fba9c355446b3ff59b/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:44.374027 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:44.384995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acf455-f2f1-4359-b09c-158bfb5d9aa1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:44.442279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc966ddb-e505-4f65-8df2-9202c19361f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:44.442898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc966ddb-e505-4f65-8df2-9202c19361f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.443232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc966ddb-e505-4f65-8df2-9202c19361f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.444030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc966ddb-e505-4f65-8df2-9202c19361f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.444716 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc966ddb-e505-4f65-8df2-9202c19361f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:44.446319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc966ddb-e505-4f65-8df2-9202c19361f8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.456504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1089/2149] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:44.460668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:44.472314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690305dc-213b-4af2-bfcb-139cacd1bb6d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:44.476982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:44.477625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.477905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.478177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] PATH_INFO: `/v3/projects/96fcc8a7552f44658f37d3e2a86fe9f8/users/68d49a99463f48fba9c355446b3ff59b/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.480167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fcc8a7552f44658f37d3e2a86fe9f8, user_id=68d49a99463f48fba9c355446b3ff59b, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:44.482861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.494533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1061/2150] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:44 2022] PUT /identity/v3/projects/96fcc8a7552f44658f37d3e2a86fe9f8/users/68d49a99463f48fba9c355446b3ff59b/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:44.504675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ce9e-7981-465c-ad39-54459adb8872 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.505403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ce9e-7981-465c-ad39-54459adb8872 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.505771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1ce9e-7981-465c-ad39-54459adb8872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.535583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-09b1ce9e-7981-465c-ad39-54459adb8872 None None] MFA Rules not processed for user `68d49a99463f48fba9c355446b3ff59b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:44.536852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-09b1ce9e-7981-465c-ad39-54459adb8872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:44.604946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1090/2151] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:44.616561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:44.618291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:44.696177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a269ec9-3411-45b6-99a0-17e6313d066b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:44.699664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:44.700248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.700549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.700817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.709809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:44.711219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.720407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1062/2152] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:44.915460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1ce9e-7981-465c-ad39-54459adb8872 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:44.925091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1ce9e-7981-465c-ad39-54459adb8872 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:44.929331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad637a-a5d8-49a6-8489-8e5065c69133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:44.929919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad637a-a5d8-49a6-8489-8e5065c69133 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:44.930192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad637a-a5d8-49a6-8489-8e5065c69133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:44.930459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad637a-a5d8-49a6-8489-8e5065c69133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:44.939354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:44.986779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad637a-a5d8-49a6-8489-8e5065c69133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:44.988139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad637a-a5d8-49a6-8489-8e5065c69133 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:44.999137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1091/2153] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:54.064523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:54.125857 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa6d05-e212-416a-b8c0-0cd06d57e1c6 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:54.130509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:54.131121 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:54.131523 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:54.131793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] PATH_INFO: `/v3/users/409fe672fb4d4b50b9f2922feac69eac` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:54.132913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409fe672fb4d4b50b9f2922feac69eac)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:54.134812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:54.155696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:54.341020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409fe672fb4d4b50b9f2922feac69eac'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:54.341666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409fe672fb4d4b50b9f2922feac69eac'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:54.353744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409fe672fb4d4b50b9f2922feac69eac'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:54.361190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409fe672fb4d4b50b9f2922feac69eac'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:54.426569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409fe672fb4d4b50b9f2922feac69eac'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:54.432506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1063/2154] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:54 2022] DELETE /identity/v3/users/409fe672fb4d4b50b9f2922feac69eac => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:54.437698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:54.438182 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:54.438285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:54.457053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:54.458246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:54.516952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1092/2155] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:54.526551 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:54.527918 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:54.583404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f11947-6695-4978-a50d-0657b07e7f15 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:54.586966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:54.587555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:54.587825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:54.588089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:54.597506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:54.598844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:54.608548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1064/2156] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:55.024735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:55.024735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:55.037610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c46ee-1d74-49f4-86bf-cdefec4dd979 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:55.042309 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:55.043019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:55.043364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:55.043728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] PATH_INFO: `/v3/projects/da367b1e694a4a22b5b95d49cf11047b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:55.044948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da367b1e694a4a22b5b95d49cf11047b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:55.046861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:55.203274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da367b1e694a4a22b5b95d49cf11047b', 'request_id': 'req-d0351b80-463d-4214-9a02-0e7f8b9ba30b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.208811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da367b1e694a4a22b5b95d49cf11047b', 'request_id': 'req-d0351b80-463d-4214-9a02-0e7f8b9ba30b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.215076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da367b1e694a4a22b5b95d49cf11047b', 'request_id': 'req-d0351b80-463d-4214-9a02-0e7f8b9ba30b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.292929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] The token cache is being invalidate because project da367b1e694a4a22b5b95d49cf11047b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:55.293216 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.293834 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.295344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1093/2157] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:55 2022] DELETE /identity/v3/projects/da367b1e694a4a22b5b95d49cf11047b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:55.299315 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:55.309031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee92c3c-8ade-436a-bda9-089caf7551ad service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:55.365926 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:55.366542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:55.366818 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:55.367086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] PATH_INFO: `/v3/users/68d49a99463f48fba9c355446b3ff59b` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:55.368173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d49a99463f48fba9c355446b3ff59b)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:55.370105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:55.596186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:55.601027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d49a99463f48fba9c355446b3ff59b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.601664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d49a99463f48fba9c355446b3ff59b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.613912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d49a99463f48fba9c355446b3ff59b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.620699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d49a99463f48fba9c355446b3ff59b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.717436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-075cdd2c-2d01-4592-81bc-fad5a671f59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d49a99463f48fba9c355446b3ff59b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:55.723350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1065/2158] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:47:55 2022] DELETE /identity/v3/users/68d49a99463f48fba9c355446b3ff59b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:56.165856 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.167582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:56.182301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351b80-463d-4214-9a02-0e7f8b9ba30b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.218895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:56.242682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.243319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.243838 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.244263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] PATH_INFO: `/v3/projects/96fcc8a7552f44658f37d3e2a86fe9f8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.245772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fcc8a7552f44658f37d3e2a86fe9f8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.248718 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.359659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fcc8a7552f44658f37d3e2a86fe9f8', 'request_id': 'req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.365627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fcc8a7552f44658f37d3e2a86fe9f8', 'request_id': 'req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.371925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fcc8a7552f44658f37d3e2a86fe9f8', 'request_id': 'req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.420761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] The token cache is being invalidate because project 96fcc8a7552f44658f37d3e2a86fe9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:47:56.421046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.421652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ab69c3d7-3ffb-41e5-a49d-e15c6236e4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:47:56.423128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1094/2159] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:47:56 2022] DELETE /identity/v3/projects/96fcc8a7552f44658f37d3e2a86fe9f8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:56.428927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dafda-8209-405d-9167-91a777bef2f1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.429399 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dafda-8209-405d-9167-91a777bef2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.429610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dafda-8209-405d-9167-91a777bef2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.450062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-db9dafda-8209-405d-9167-91a777bef2f1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:56.451807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-db9dafda-8209-405d-9167-91a777bef2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:56.511347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1066/2160] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:56.519227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be18f-6f57-4ab3-967d-0fe6e385f0ef None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.519612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be18f-6f57-4ab3-967d-0fe6e385f0ef None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.519947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be18f-6f57-4ab3-967d-0fe6e385f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.539555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7e0be18f-6f57-4ab3-967d-0fe6e385f0ef None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:56.540777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7e0be18f-6f57-4ab3-967d-0fe6e385f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:56.549050 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1095/2161] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:56.553168 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dafda-8209-405d-9167-91a777bef2f1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.563279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dafda-8209-405d-9167-91a777bef2f1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.567822 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.568404 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.568715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.568986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.569628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:47:56.569930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.571506 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.582778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1067/2162] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:47:56.586760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be18f-6f57-4ab3-967d-0fe6e385f0ef None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.596619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be18f-6f57-4ab3-967d-0fe6e385f0ef None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.602062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.602655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.602928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.603192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.603825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.605748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.679431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1096/2163] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:56 2022] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:56.683541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.694251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd106f-665c-4a7b-8951-c8849b6d13cd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.750114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.750702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.750978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.751244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.751861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.753806 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.850924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1068/2164] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:56 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:56.855339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.866605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083884e-d7c8-4df6-bbf8-3f12bbe57676 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.871394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.872163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.872458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.872737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.873429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.875074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.885614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1097/2165] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:56.889547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.899387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff1738-9cf2-442d-9c8d-a2b58d2f434b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.904673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1045695-29e8-4a41-85fd-a65ef8a681e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.905264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045695-29e8-4a41-85fd-a65ef8a681e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.905534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045695-29e8-4a41-85fd-a65ef8a681e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.905798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1045695-29e8-4a41-85fd-a65ef8a681e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.906446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1045695-29e8-4a41-85fd-a65ef8a681e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.908007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1045695-29e8-4a41-85fd-a65ef8a681e3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:56.919816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1069/2166] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:56.923954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:56.933965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caec0b-8f84-4ba2-b6e1-11f0c2689274 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:56.939414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:56.942307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:56.942307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:56.942307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] PATH_INFO: `/v3/projects/41bc0eeb6c5948b1828beb160df35121/users/9ca3dc1a85e44e82960911c12bc31094/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:56.955847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bc0eeb6c5948b1828beb160df35121, user_id=9ca3dc1a85e44e82960911c12bc31094, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:56.959547 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.050440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1098/2167] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:56 2022] PUT /identity/v3/projects/41bc0eeb6c5948b1828beb160df35121/users/9ca3dc1a85e44e82960911c12bc31094/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:57.063103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44091-91e4-4b60-b4c8-03dc4caa3488 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.063103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44091-91e4-4b60-b4c8-03dc4caa3488 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.063103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe44091-91e4-4b60-b4c8-03dc4caa3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.089979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6fe44091-91e4-4b60-b4c8-03dc4caa3488 None None] MFA Rules not processed for user `9ca3dc1a85e44e82960911c12bc31094`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:57.100334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6fe44091-91e4-4b60-b4c8-03dc4caa3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:57.103677 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:57.159801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1070/2168] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:57.164200 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.232963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc85b1-de4e-4b50-973c-a4561115030c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.237625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.238228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.238499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.238763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.239383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.243617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.246611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:57.313781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1099/2169] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/projects => generated 401 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:57.317941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe44091-91e4-4b60-b4c8-03dc4caa3488 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.328929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe44091-91e4-4b60-b4c8-03dc4caa3488 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.384206 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.393959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.393959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.393959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.393959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.393959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.461049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1071/2170] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/users => generated 307 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:47:57.464853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.475467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165dd5c6-20f1-4be3-b54d-5b851cc48da9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.480142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.480761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.481038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.481304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.481935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.483609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.493488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1100/2171] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:57.497456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.507095 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06876c-c550-47b5-878a-bc8599e42090 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.511630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.512251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.512557 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.513411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] PATH_INFO: `/v3/projects/cc5768b5f7684b3a8c05e664b61e8bd5/users/7d00139c3f444e3d878d5a93647feb56/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.527504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5768b5f7684b3a8c05e664b61e8bd5, user_id=7d00139c3f444e3d878d5a93647feb56, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.530800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.598750 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1072/2172] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:57 2022] PUT /identity/v3/projects/cc5768b5f7684b3a8c05e664b61e8bd5/users/7d00139c3f444e3d878d5a93647feb56/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:47:57.602675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.612747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb29c3b-c876-4854-810b-6ba3ce017ca9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.668448 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e726265-f3de-4f1f-84c1-da2da1c08c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.669056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e726265-f3de-4f1f-84c1-da2da1c08c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.669336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e726265-f3de-4f1f-84c1-da2da1c08c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.669608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e726265-f3de-4f1f-84c1-da2da1c08c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.670246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e726265-f3de-4f1f-84c1-da2da1c08c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.671837 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e726265-f3de-4f1f-84c1-da2da1c08c4c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.681702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1101/2173] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:47:57.686311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.696708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60d832-ae5c-465d-91b7-1bd32a017ebb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.701889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.702524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.702801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.703071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] PATH_INFO: `/v3/projects/cc5768b5f7684b3a8c05e664b61e8bd5/users/7d00139c3f444e3d878d5a93647feb56/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.705056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5768b5f7684b3a8c05e664b61e8bd5, user_id=7d00139c3f444e3d878d5a93647feb56, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.707684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.718011 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1073/2174] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:47:57 2022] PUT /identity/v3/projects/cc5768b5f7684b3a8c05e664b61e8bd5/users/7d00139c3f444e3d878d5a93647feb56/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:47:57.728254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ce24-97be-48e3-858f-16c431890fe4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.728575 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ce24-97be-48e3-858f-16c431890fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.728854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0ce24-97be-48e3-858f-16c431890fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.756348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-90c0ce24-97be-48e3-858f-16c431890fe4 None None] MFA Rules not processed for user `7d00139c3f444e3d878d5a93647feb56`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:47:57.757577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-90c0ce24-97be-48e3-858f-16c431890fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:57.823908 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1102/2175] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:47:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:47:57.839923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:57.841694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:47:57.898342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56939b-7249-4e83-9abd-9904f940b789 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:57.902047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:57.902635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:57.902936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:57.903204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:57.912180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:57.913630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:57.922759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1074/2176] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:47:58.138816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0ce24-97be-48e3-858f-16c431890fe4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:47:58.148565 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0ce24-97be-48e3-858f-16c431890fe4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:47:58.154080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea59a6f-c033-45fe-a4eb-3c3268d8f133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:47:58.154080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59a6f-c033-45fe-a4eb-3c3268d8f133 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:47:58.154080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59a6f-c033-45fe-a4eb-3c3268d8f133 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:47:58.154080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59a6f-c033-45fe-a4eb-3c3268d8f133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:47:58.210112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:47:58.212338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea59a6f-c033-45fe-a4eb-3c3268d8f133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:47:58.213810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea59a6f-c033-45fe-a4eb-3c3268d8f133 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:47:58.223782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1103/2177] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:47:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:03.238456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:03.253100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:03.311270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b938d-3793-45f7-9b4d-5204ecc663d7 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:03.316204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:03.316930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:03.317333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:03.317662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] PATH_INFO: `/v3/users/9ca3dc1a85e44e82960911c12bc31094` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:03.318839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca3dc1a85e44e82960911c12bc31094)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:03.320954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:03.480066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca3dc1a85e44e82960911c12bc31094'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.481286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca3dc1a85e44e82960911c12bc31094'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.497113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca3dc1a85e44e82960911c12bc31094'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.506023 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca3dc1a85e44e82960911c12bc31094'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.597359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca3dc1a85e44e82960911c12bc31094'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:03.604469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1075/2178] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:03 2022] DELETE /identity/v3/users/9ca3dc1a85e44e82960911c12bc31094 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:03.609567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:03.610035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:03.614278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:03.630208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:03.631526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:03.697643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1104/2179] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:03.707384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:03.708855 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:03.767609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87891c1e-c6fb-4c75-b6ce-572edcc8a1c0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:03.771273 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:03.771873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:03.772153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:03.772446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:03.782541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:03.784221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:03.794411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1076/2180] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:04.240146 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:04.242039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:04.261715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9e62c-97cb-43ca-9c76-4e8986adda87 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:04.270333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:04.270333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:04.270913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:04.270913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] PATH_INFO: `/v3/projects/41bc0eeb6c5948b1828beb160df35121` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:04.271958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bc0eeb6c5948b1828beb160df35121)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:04.274032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:04.425731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bc0eeb6c5948b1828beb160df35121', 'request_id': 'req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.431331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bc0eeb6c5948b1828beb160df35121', 'request_id': 'req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.437628 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bc0eeb6c5948b1828beb160df35121', 'request_id': 'req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.529735 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] The token cache is being invalidate because project 41bc0eeb6c5948b1828beb160df35121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:04.530010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.530614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.532089 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1105/2181] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:04 2022] DELETE /identity/v3/projects/41bc0eeb6c5948b1828beb160df35121 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:04.536365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:04.546267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce110f92-976b-419c-86e8-468e52f5b647 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:04.574475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:04.600996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:04.601602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:04.601876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:04.602142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] PATH_INFO: `/v3/users/7d00139c3f444e3d878d5a93647feb56` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:04.603237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d00139c3f444e3d878d5a93647feb56)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:04.605177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:04.788650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d00139c3f444e3d878d5a93647feb56'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.789269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d00139c3f444e3d878d5a93647feb56'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.801805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d00139c3f444e3d878d5a93647feb56'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.809167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d00139c3f444e3d878d5a93647feb56'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.873442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-db6544ea-1cd7-4aa3-a52d-e909ae77546f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d00139c3f444e3d878d5a93647feb56'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:04.881669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1077/2182] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:04 2022] DELETE /identity/v3/users/7d00139c3f444e3d878d5a93647feb56 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:05.303394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:05.304969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:05.318720 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90f4a-5169-4bf5-9334-e4fc0ffd6ce3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:05.374610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:05.375222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:05.375500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:05.375768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] PATH_INFO: `/v3/projects/cc5768b5f7684b3a8c05e664b61e8bd5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:05.376893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5768b5f7684b3a8c05e664b61e8bd5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:05.378773 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:05.400692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:05.472985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5768b5f7684b3a8c05e664b61e8bd5', 'request_id': 'req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:05.478346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5768b5f7684b3a8c05e664b61e8bd5', 'request_id': 'req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:05.484594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5768b5f7684b3a8c05e664b61e8bd5', 'request_id': 'req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:05.585700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] The token cache is being invalidate because project cc5768b5f7684b3a8c05e664b61e8bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:05.585985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:05.586620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d3d9cd5d-ea2b-41fd-8cd9-5a4bdbf29cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:05.588083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1106/2183] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:05 2022] DELETE /identity/v3/projects/cc5768b5f7684b3a8c05e664b61e8bd5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:05.593482 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474b4e-c4fd-4af3-99ad-761fcaabed00 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:05.593973 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474b4e-c4fd-4af3-99ad-761fcaabed00 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:05.594083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474b4e-c4fd-4af3-99ad-761fcaabed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:05.613742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a2474b4e-c4fd-4af3-99ad-761fcaabed00 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:05.614942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a2474b4e-c4fd-4af3-99ad-761fcaabed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:05.672859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1078/2184] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:05.680537 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c140d-cb48-4890-8bed-f15b9f6eb778 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:05.680818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c140d-cb48-4890-8bed-f15b9f6eb778 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:05.681086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c140d-cb48-4890-8bed-f15b9f6eb778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:05.700617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-101c140d-cb48-4890-8bed-f15b9f6eb778 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:05.702311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-101c140d-cb48-4890-8bed-f15b9f6eb778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:05.710032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1107/2185] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:05.714042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474b4e-c4fd-4af3-99ad-761fcaabed00 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:05.724202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474b4e-c4fd-4af3-99ad-761fcaabed00 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:05.728714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:05.729295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:05.729571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:05.729840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:05.730472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:05.730768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:05.732366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:05.743570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1079/2186] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:48:05.747540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c140d-cb48-4890-8bed-f15b9f6eb778 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:05.756941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c140d-cb48-4890-8bed-f15b9f6eb778 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:05.761491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:05.762068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:05.762366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:05.762635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:05.763769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:05.765700 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:05.874811 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1108/2187] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:05 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:48:05.878943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:05.889783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c06926-f1f4-4cd4-8ce4-981f295e1b23 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:05.923871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:05.946416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:05.947011 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:05.947287 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:05.947555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:05.948184 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:05.950120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.067863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1080/2188] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:05 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:06.071968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.082650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c89d06-cf35-4fed-a0f7-132142e1b3a5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.087207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.087784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.088056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.088342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.089024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.090632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.100642 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1109/2189] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:06.104552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.114732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d0ee9-fe9e-496c-822b-50efea48f1b8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.120103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1c03b-e055-4d4e-af06-150548f8bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.120826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c03b-e055-4d4e-af06-150548f8bf47 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.121173 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c03b-e055-4d4e-af06-150548f8bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.121626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1c03b-e055-4d4e-af06-150548f8bf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.122272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1c03b-e055-4d4e-af06-150548f8bf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.124407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1c03b-e055-4d4e-af06-150548f8bf47 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.135950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1081/2190] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:06.141753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.151855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dc2c6-ba74-49db-bca3-ed45ced0cdfe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.156824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.157581 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.157914 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.158181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] PATH_INFO: `/v3/projects/5ed805a3bb834e828a82a7a69caa4c5d/users/a26af4b099fe44be88f134dfe713950f/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.173229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed805a3bb834e828a82a7a69caa4c5d, user_id=a26af4b099fe44be88f134dfe713950f, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.176201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.233287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1110/2191] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:06 2022] PUT /identity/v3/projects/5ed805a3bb834e828a82a7a69caa4c5d/users/a26af4b099fe44be88f134dfe713950f/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:06.244574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349751-2e60-4db1-9395-92cd6724982d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.244886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349751-2e60-4db1-9395-92cd6724982d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.245159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb349751-2e60-4db1-9395-92cd6724982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.272968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fb349751-2e60-4db1-9395-92cd6724982d None None] MFA Rules not processed for user `a26af4b099fe44be88f134dfe713950f`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:06.274177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fb349751-2e60-4db1-9395-92cd6724982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:06.340313 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1082/2192] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:06.344999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.406784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f97f-7623-4fe8-825a-556fa560033d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.411564 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.412164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.412454 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.412744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.418584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.418584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.497188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1111/2193] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:06 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:06.501832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb349751-2e60-4db1-9395-92cd6724982d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.512369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb349751-2e60-4db1-9395-92cd6724982d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.567512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.568098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.568373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.568667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.569293 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.571185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.688504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1083/2194] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:06 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:06.692311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.702902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0af13-c534-4c2f-bed7-dea8b0b6af8d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.707480 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.708068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.708347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.708654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.709334 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.710938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.721825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1112/2195] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:06.725849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.736279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0dba3-a284-4d14-a1dd-c1899d04de0f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.740924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.741556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.741832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.742099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] PATH_INFO: `/v3/projects/dc68f52fd8ae4949a8ad191890d85d9b/users/2d24242561884667848acd800f5c3f3e/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.756459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc68f52fd8ae4949a8ad191890d85d9b, user_id=2d24242561884667848acd800f5c3f3e, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.759128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.855217 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1084/2196] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:06 2022] PUT /identity/v3/projects/dc68f52fd8ae4949a8ad191890d85d9b/users/2d24242561884667848acd800f5c3f3e/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:06.860029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.872677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e3ebc-e56e-47d1-b852-0f38f88e0e6f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.888883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:06.932954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb851ad-a59f-4eca-80c3-5288a145bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.933556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb851ad-a59f-4eca-80c3-5288a145bad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.933833 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb851ad-a59f-4eca-80c3-5288a145bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.934104 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb851ad-a59f-4eca-80c3-5288a145bad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.934743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb851ad-a59f-4eca-80c3-5288a145bad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.936327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb851ad-a59f-4eca-80c3-5288a145bad5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.946039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1113/2197] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:06.950311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:06.960969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995dab0-cd9b-4a0d-87e3-b2ddfe1acb9f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:06.965559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:06.974016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.974016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.974016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] PATH_INFO: `/v3/projects/dc68f52fd8ae4949a8ad191890d85d9b/users/2d24242561884667848acd800f5c3f3e/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:06.974016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc68f52fd8ae4949a8ad191890d85d9b, user_id=2d24242561884667848acd800f5c3f3e, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:06.974016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:06.977970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:06.983178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1085/2198] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:06 2022] PUT /identity/v3/projects/dc68f52fd8ae4949a8ad191890d85d9b/users/2d24242561884667848acd800f5c3f3e/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:06.993578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819851da-e205-4856-b717-bc3a819fb3e5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:06.993875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819851da-e205-4856-b717-bc3a819fb3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:06.994500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819851da-e205-4856-b717-bc3a819fb3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:07.023952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-819851da-e205-4856-b717-bc3a819fb3e5 None None] MFA Rules not processed for user `2d24242561884667848acd800f5c3f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:07.025175 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-819851da-e205-4856-b717-bc3a819fb3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:07.092786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1114/2199] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:07.104798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:07.106563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:07.165529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb10b31-3ea8-4eed-846d-ef334204c2ea admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:07.169193 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:07.169909 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:07.170190 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:07.170464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:07.179766 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:07.181228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:07.190544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1086/2200] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:07.333118 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819851da-e205-4856-b717-bc3a819fb3e5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:07.342543 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819851da-e205-4856-b717-bc3a819fb3e5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:07.346015 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb6e1-630f-4a26-b179-2bda4a5425bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:07.346633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb6e1-630f-4a26-b179-2bda4a5425bb service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:07.346885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb6e1-630f-4a26-b179-2bda4a5425bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:07.347150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb6e1-630f-4a26-b179-2bda4a5425bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:07.401892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb6e1-630f-4a26-b179-2bda4a5425bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:07.403313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb6e1-630f-4a26-b179-2bda4a5425bb service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:07.412353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1115/2201] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:07.869503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:07.931119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369e9a-1351-40a2-bd8e-ca29f584b608 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:07.936125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:07.936775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:07.937046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:07.937309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] PATH_INFO: `/v3/users/a26af4b099fe44be88f134dfe713950f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:07.938407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26af4b099fe44be88f134dfe713950f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:07.940317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:08.142801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26af4b099fe44be88f134dfe713950f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.143467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26af4b099fe44be88f134dfe713950f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.155646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26af4b099fe44be88f134dfe713950f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.162947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26af4b099fe44be88f134dfe713950f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.238244 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26af4b099fe44be88f134dfe713950f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.244268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1087/2202] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:07 2022] DELETE /identity/v3/users/a26af4b099fe44be88f134dfe713950f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:08.249501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.252484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.252484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.269319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:08.270496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.302296 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:08.328078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1116/2203] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:08.338183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:08.339636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.361361 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:08.397089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f518ff-bbda-46be-9b83-9ffe4192c0d4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:08.400607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:08.401245 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.401602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.401859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.411440 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:08.412898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:08.422168 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1088/2204] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:08.828458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:08.829921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:08.842472 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef4219-bd59-4120-a486-f5fb29ddc527 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:08.847110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:08.847741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:08.848021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:08.848294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] PATH_INFO: `/v3/projects/5ed805a3bb834e828a82a7a69caa4c5d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:08.849573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed805a3bb834e828a82a7a69caa4c5d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:08.851499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:08.970704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed805a3bb834e828a82a7a69caa4c5d', 'request_id': 'req-a1d595f9-0a09-4422-a69f-646a05f85ec3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.976331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed805a3bb834e828a82a7a69caa4c5d', 'request_id': 'req-a1d595f9-0a09-4422-a69f-646a05f85ec3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:08.983332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed805a3bb834e828a82a7a69caa4c5d', 'request_id': 'req-a1d595f9-0a09-4422-a69f-646a05f85ec3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.071652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] The token cache is being invalidate because project 5ed805a3bb834e828a82a7a69caa4c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:09.071937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.072585 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.074075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1117/2205] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:08 2022] DELETE /identity/v3/projects/5ed805a3bb834e828a82a7a69caa4c5d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:09.078059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.087786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3153d8-93a2-49f0-852e-b40facb67513 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:09.144015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:09.144679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.144959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.145231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] PATH_INFO: `/v3/users/2d24242561884667848acd800f5c3f3e` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.146343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d24242561884667848acd800f5c3f3e)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:09.148263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:09.348748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d24242561884667848acd800f5c3f3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.351607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d24242561884667848acd800f5c3f3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.362398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d24242561884667848acd800f5c3f3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.369219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d24242561884667848acd800f5c3f3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.426448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-aa153d17-5f46-4836-85dd-b1edd3bbc69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d24242561884667848acd800f5c3f3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:09.432383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1089/2206] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:48:09 2022] DELETE /identity/v3/users/2d24242561884667848acd800f5c3f3e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:09.868689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:09.870105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:09.884932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d595f9-0a09-4422-a69f-646a05f85ec3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:09.943676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:09.944300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:09.944615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:09.944884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] PATH_INFO: `/v3/projects/dc68f52fd8ae4949a8ad191890d85d9b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:09.945999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc68f52fd8ae4949a8ad191890d85d9b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:09.947933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.088660 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc68f52fd8ae4949a8ad191890d85d9b', 'request_id': 'req-13b25273-4de3-4420-b88c-a1d037bba2a5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:10.094758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc68f52fd8ae4949a8ad191890d85d9b', 'request_id': 'req-13b25273-4de3-4420-b88c-a1d037bba2a5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:10.101356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc68f52fd8ae4949a8ad191890d85d9b', 'request_id': 'req-13b25273-4de3-4420-b88c-a1d037bba2a5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:10.104045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:10.232042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] The token cache is being invalidate because project dc68f52fd8ae4949a8ad191890d85d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:48:10.232336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:10.232977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13b25273-4de3-4420-b88c-a1d037bba2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:48:10.234488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1118/2207] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:48:09 2022] DELETE /identity/v3/projects/dc68f52fd8ae4949a8ad191890d85d9b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:10.239391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527037-f532-4669-8936-4f92d4d601bd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.239839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527037-f532-4669-8936-4f92d4d601bd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.239934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527037-f532-4669-8936-4f92d4d601bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.259092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-67527037-f532-4669-8936-4f92d4d601bd None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:10.260268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-67527037-f532-4669-8936-4f92d4d601bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:10.298694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:10.319171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1090/2208] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:10.328174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee85ee-de72-42d8-8756-479a43f2121f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.328485 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee85ee-de72-42d8-8756-479a43f2121f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.328763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee85ee-de72-42d8-8756-479a43f2121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.347952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-53ee85ee-de72-42d8-8756-479a43f2121f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:10.349183 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-53ee85ee-de72-42d8-8756-479a43f2121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:10.356868 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1119/2209] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:10.361036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67527037-f532-4669-8936-4f92d4d601bd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.371083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67527037-f532-4669-8936-4f92d4d601bd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.376091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.376707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.379096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.379096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.379096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:48:10.379096 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.379739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.392768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1091/2210] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 07:48:10.397100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee85ee-de72-42d8-8756-479a43f2121f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.406418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee85ee-de72-42d8-8756-479a43f2121f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.411590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.412193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.412510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.413569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.413569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.415755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.491077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1120/2211] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:10.495281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.505550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c8158-750e-4541-96fa-af99afef85d8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.561341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.561947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.562222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.562492 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.563113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.565066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.690417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1092/2212] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:10.694453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.705236 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcba4c0-e205-4ca9-9dc1-9ad30f20ec80 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.709668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.710248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.710522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.710789 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.711421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.713045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.722848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1121/2213] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:10.726555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.736835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5e9d3-b32f-4a09-b3a0-13807ce22178 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.741258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a6749-eb0b-474e-9f16-d5adc131ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.741825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a6749-eb0b-474e-9f16-d5adc131ff27 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.742099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a6749-eb0b-474e-9f16-d5adc131ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.742366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a6749-eb0b-474e-9f16-d5adc131ff27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.742990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a6749-eb0b-474e-9f16-d5adc131ff27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.744589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a6749-eb0b-474e-9f16-d5adc131ff27 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.755394 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1093/2214] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:10.759202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:10.768777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fab18-c14d-4eb0-86e3-f9ad7a31777b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:10.773210 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:10.773830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.774105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.774372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] PATH_INFO: `/v3/projects/e93eeb2dcf2d4457a658b2cb83bebf4a/users/8a8a2cf43bf54dba8705f66662e46fa6/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.788842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93eeb2dcf2d4457a658b2cb83bebf4a, user_id=8a8a2cf43bf54dba8705f66662e46fa6, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:10.791452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:10.908406 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1122/2215] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:10 2022] PUT /identity/v3/projects/e93eeb2dcf2d4457a658b2cb83bebf4a/users/8a8a2cf43bf54dba8705f66662e46fa6/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:10.913983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa1a4-616b-4dce-aa0d-5bb3a897110f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:10.914373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa1a4-616b-4dce-aa0d-5bb3a897110f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:10.914713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6aa1a4-616b-4dce-aa0d-5bb3a897110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:10.933767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-5e6aa1a4-616b-4dce-aa0d-5bb3a897110f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:10.934958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5e6aa1a4-616b-4dce-aa0d-5bb3a897110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:10.992172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1094/2216] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:11.001739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:11.003754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:11.061506 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb64dc-9ef4-4a11-ab58-41e90d8bffc8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:11.065148 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:11.065746 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:11.066025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:11.066298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:11.075391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:11.077447 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:11.086631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1123/2217] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:48:12.330936 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b445bb-37c5-42ce-8237-39f3c3d4c989 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.331427 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b445bb-37c5-42ce-8237-39f3c3d4c989 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.331626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b445bb-37c5-42ce-8237-39f3c3d4c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.360583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-50b445bb-37c5-42ce-8237-39f3c3d4c989 None None] MFA Rules not processed for user `8a8a2cf43bf54dba8705f66662e46fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:12.361778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-50b445bb-37c5-42ce-8237-39f3c3d4c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:12.400408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:12.428731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1095/2218] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:12.433277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.443623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc85c5d-259a-4163-a5a3-6b6576ed6574 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.451132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.451132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.451132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.451132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.451493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.453028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.543374 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1124/2219] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:48:12 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:12.547231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b445bb-37c5-42ce-8237-39f3c3d4c989 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.557919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b445bb-37c5-42ce-8237-39f3c3d4c989 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.613558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.614158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.614441 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.614713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.615379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.617337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.678390 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1096/2220] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:48:12 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:48:12.682224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.693474 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc99340-0a9c-48fd-896d-722eb15f0288 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.698165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.701279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.701279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.701279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.701279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.702080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.713849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1125/2221] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:48:12.718003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.727974 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c892a-c519-436c-807f-379ee470fd8c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.732610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.733189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.733469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.733741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] PATH_INFO: `/v3/projects/90a5902edae4494ab8c62799549721fa/users/30710b5361cc43798d213df025fad28a/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.748787 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a5902edae4494ab8c62799549721fa, user_id=30710b5361cc43798d213df025fad28a, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.751487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.821188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1097/2222] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:12 2022] PUT /identity/v3/projects/90a5902edae4494ab8c62799549721fa/users/30710b5361cc43798d213df025fad28a/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:12.825139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.835599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8ae16-dd60-4a27-ba85-a7f9f27745bc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.895067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74e98b-5fa9-442d-a626-5408955288d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.895675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e98b-5fa9-442d-a626-5408955288d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.895954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e98b-5fa9-442d-a626-5408955288d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.896223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e98b-5fa9-442d-a626-5408955288d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.896888 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e98b-5fa9-442d-a626-5408955288d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.898476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e98b-5fa9-442d-a626-5408955288d4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.899666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:12.909494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1126/2223] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:48:12.913253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:12.923756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a6a5b-a3d6-4467-b4c2-835b9479e6cc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:12.928385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70da7db-678c-48f3-9a9d-a2b124f494c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:12.929052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da7db-678c-48f3-9a9d-a2b124f494c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:12.929328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da7db-678c-48f3-9a9d-a2b124f494c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:12.929593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da7db-678c-48f3-9a9d-a2b124f494c1 admin admin] PATH_INFO: `/v3/projects/90a5902edae4494ab8c62799549721fa/users/30710b5361cc43798d213df025fad28a/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:12.931517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70da7db-678c-48f3-9a9d-a2b124f494c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a5902edae4494ab8c62799549721fa, user_id=30710b5361cc43798d213df025fad28a, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:12.934174 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70da7db-678c-48f3-9a9d-a2b124f494c1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:12.944584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1098/2224] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:48:12 2022] PUT /identity/v3/projects/90a5902edae4494ab8c62799549721fa/users/30710b5361cc43798d213df025fad28a/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:48:14.300614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.301029 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.301143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.332851 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] MFA Rules not processed for user `30710b5361cc43798d213df025fad28a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:14.334113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:14.402621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1127/2225] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:48:14.414427 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.414899 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.414993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.434317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] MFA Rules not processed for user `8a8a2cf43bf54dba8705f66662e46fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:14.436026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:14.491383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1099/2226] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:48:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:14.504644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:14.506055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:14.578413 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6417a8-4fcb-4af6-a78b-185a8bb2e43a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:14.583751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44e9b0-bdf2-444a-a347-4414f780ac31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:14.584347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e9b0-bdf2-444a-a347-4414f780ac31 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:14.584650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e9b0-bdf2-444a-a347-4414f780ac31 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:14.584921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e9b0-bdf2-444a-a347-4414f780ac31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:14.592466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44e9b0-bdf2-444a-a347-4414f780ac31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:14.594059 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44e9b0-bdf2-444a-a347-4414f780ac31 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:14.602744 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1128/2227] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:24.485017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:24.598755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=70 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:31.967375 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:31.969331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:32.024539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1169e-937b-4ae4-ba9e-247e700a3bc9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:32.027988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212b446-8506-4263-925e-84f465253216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:32.028611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b446-8506-4263-925e-84f465253216 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:32.028886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b446-8506-4263-925e-84f465253216 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:32.029151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b446-8506-4263-925e-84f465253216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:32.038693 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212b446-8506-4263-925e-84f465253216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:32.040125 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212b446-8506-4263-925e-84f465253216 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:32.049275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1100/2228] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:48:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:48:42.045136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=26 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:48:51.762533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:51.763010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:51.763132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:51.795364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:48:51.796792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:51.853100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1129/2229] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:48:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:48:52.001829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212b446-8506-4263-925e-84f465253216 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:48:52.003830 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2212b446-8506-4263-925e-84f465253216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:48:52.076115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212b446-8506-4263-925e-84f465253216 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:48:52.081132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:48:52.081725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:48:52.081998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:48:52.082263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:48:52.090265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:48:52.091829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:48:52.099998 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1101/2230] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:48:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:49:00.072048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:00.075597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:00.200818 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095535a-b81a-47cc-aca5-f8d24ed45f06 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:00.206929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:00.207672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:00.208047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:00.208415 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:00.210717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:00.228569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:00.230372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:00.248645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1130/2231] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:01.040420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.145970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b7542-941d-4e8f-9237-3cbc159483ec service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.151388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.152132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.152494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.152838 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] PATH_INFO: `/v3/users/8a8a2cf43bf54dba8705f66662e46fa6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.154016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8a2cf43bf54dba8705f66662e46fa6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.156126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.430789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8a2cf43bf54dba8705f66662e46fa6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.431706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8a2cf43bf54dba8705f66662e46fa6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.444886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8a2cf43bf54dba8705f66662e46fa6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.455515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8a2cf43bf54dba8705f66662e46fa6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.535629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8a2cf43bf54dba8705f66662e46fa6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:01.542628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1102/2232] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:01 2022] DELETE /identity/v3/users/8a8a2cf43bf54dba8705f66662e46fa6 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:01.802105 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:01.815512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786368e-f4ea-42b9-89bd-44c046af082e service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:01.885730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:01.885730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:01.886181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:01.886650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] PATH_INFO: `/v3/projects/e93eeb2dcf2d4457a658b2cb83bebf4a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:01.887882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93eeb2dcf2d4457a658b2cb83bebf4a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:01.889862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:01.901634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:02.091003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93eeb2dcf2d4457a658b2cb83bebf4a', 'request_id': 'req-07a72a98-500a-4b30-87b2-b7fd98ac9a96'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.098331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93eeb2dcf2d4457a658b2cb83bebf4a', 'request_id': 'req-07a72a98-500a-4b30-87b2-b7fd98ac9a96'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.106922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93eeb2dcf2d4457a658b2cb83bebf4a', 'request_id': 'req-07a72a98-500a-4b30-87b2-b7fd98ac9a96'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.178450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] The token cache is being invalidate because project e93eeb2dcf2d4457a658b2cb83bebf4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:02.189592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.189592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.189592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1131/2233] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:01 2022] DELETE /identity/v3/projects/e93eeb2dcf2d4457a658b2cb83bebf4a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:02.189927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:02.189927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:02.200652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b3e57-e7b5-497b-9778-4c44b432ff58 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:02.208074 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:02.284037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:02.285848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:02.286323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:02.286862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] PATH_INFO: `/v3/users/30710b5361cc43798d213df025fad28a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:02.288751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30710b5361cc43798d213df025fad28a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:02.292366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:02.539840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30710b5361cc43798d213df025fad28a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.540575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30710b5361cc43798d213df025fad28a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.556993 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30710b5361cc43798d213df025fad28a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.565186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30710b5361cc43798d213df025fad28a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.666025 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-896d7d9d-6cc5-4141-80a7-8dfd08abbf3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30710b5361cc43798d213df025fad28a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:02.673075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1103/2234] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:02 2022] DELETE /identity/v3/users/30710b5361cc43798d213df025fad28a => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:03.103583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:03.105069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:03.119245 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72a98-500a-4b30-87b2-b7fd98ac9a96 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:03.190944 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:03.191587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.191863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.192133 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] PATH_INFO: `/v3/projects/90a5902edae4494ab8c62799549721fa` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.193872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a5902edae4494ab8c62799549721fa)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:03.195915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:03.386867 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a5902edae4494ab8c62799549721fa', 'request_id': 'req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.392318 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a5902edae4494ab8c62799549721fa', 'request_id': 'req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.399569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a5902edae4494ab8c62799549721fa', 'request_id': 'req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.523956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] The token cache is being invalidate because project 90a5902edae4494ab8c62799549721fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:03.524243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.525221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6de9dd1-04f7-467b-bbce-bf74d1cb71e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:03.529752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1132/2235] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:03 2022] DELETE /identity/v3/projects/90a5902edae4494ab8c62799549721fa => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:03.531381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc96c-87df-4853-b6aa-15e2bb667340 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.531858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc96c-87df-4853-b6aa-15e2bb667340 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.531964 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cc96c-87df-4853-b6aa-15e2bb667340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.554881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-848cc96c-87df-4853-b6aa-15e2bb667340 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:03.559829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-848cc96c-87df-4853-b6aa-15e2bb667340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:03.652056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1104/2236] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:03.659835 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d26e-156f-4d95-8e0e-b2efdf63e39f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.660639 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d26e-156f-4d95-8e0e-b2efdf63e39f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.660913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016d26e-156f-4d95-8e0e-b2efdf63e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.684461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c016d26e-156f-4d95-8e0e-b2efdf63e39f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:03.685702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c016d26e-156f-4d95-8e0e-b2efdf63e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:03.696470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1133/2237] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:03.700045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cc96c-87df-4853-b6aa-15e2bb667340 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:03.710970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cc96c-87df-4853-b6aa-15e2bb667340 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:03.716748 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:03.717558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.717716 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.717984 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.718647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:03.718954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:03.720644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:03.742453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1105/2238] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:03.746910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016d26e-156f-4d95-8e0e-b2efdf63e39f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:03.762883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016d26e-156f-4d95-8e0e-b2efdf63e39f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:03.769164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:03.769886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.770260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.770623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.771994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:03.774016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:03.901458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:03.914082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1134/2239] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:03 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:03.915342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:03.926739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d379183-fd26-434c-b6ce-e86f048efc0f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:03.942362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:03.990827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:03.991443 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:03.991721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:03.992015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:03.992649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:03.994561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.123289 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1106/2240] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:03 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:04.124514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.139125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1679cf2-83c7-457a-aed9-f81b43c0ea2a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:04.143946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:04.144614 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.144896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.145238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.145966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:04.147599 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.158766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1135/2241] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:04.162711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.173683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a9850-d80f-43d6-bc9f-2f2d2c72aaf8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:04.179924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af1349-0caf-473a-a483-28c2dc8cbf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:04.183052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1349-0caf-473a-a483-28c2dc8cbf59 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.183052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1349-0caf-473a-a483-28c2dc8cbf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.183052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1349-0caf-473a-a483-28c2dc8cbf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.183052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1349-0caf-473a-a483-28c2dc8cbf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:04.183444 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1349-0caf-473a-a483-28c2dc8cbf59 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.196099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1107/2242] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:04.200298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.212676 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ee35a-1e2f-4a17-9a4f-b0616194959c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:04.217423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:04.218157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.218432 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.218706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] PATH_INFO: `/v3/projects/97b939cac0f7482d8c8986e942406513/users/8b23f760eaa24190a2d07716b5bdf147/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.236689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b939cac0f7482d8c8986e942406513, user_id=8b23f760eaa24190a2d07716b5bdf147, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:04.239493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.431988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1136/2243] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:04 2022] PUT /identity/v3/projects/97b939cac0f7482d8c8986e942406513/users/8b23f760eaa24190a2d07716b5bdf147/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:04.494981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243c93-65c4-48e5-ada3-27f9fe97fe96 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.495269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243c93-65c4-48e5-ada3-27f9fe97fe96 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.495600 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243c93-65c4-48e5-ada3-27f9fe97fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.525768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c0243c93-65c4-48e5-ada3-27f9fe97fe96 None None] MFA Rules not processed for user `8b23f760eaa24190a2d07716b5bdf147`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:04.527006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c0243c93-65c4-48e5-ada3-27f9fe97fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:04.595731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1108/2244] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:04.607399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:04.609206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:04.669554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab568a4-696b-42cb-8b18-0f19d7415989 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:04.673338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5835dc-cb9e-4651-b6a2-4e9350688b6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:04.673932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5835dc-cb9e-4651-b6a2-4e9350688b6c service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:04.674212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5835dc-cb9e-4651-b6a2-4e9350688b6c service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:04.674482 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5835dc-cb9e-4651-b6a2-4e9350688b6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:04.689608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5835dc-cb9e-4651-b6a2-4e9350688b6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:04.689608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5835dc-cb9e-4651-b6a2-4e9350688b6c service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:04.695697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1137/2245] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:12.183684 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91609c-a054-4c5e-ab65-0442cb2390b9 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.184225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91609c-a054-4c5e-ab65-0442cb2390b9 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.184225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91609c-a054-4c5e-ab65-0442cb2390b9 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.186026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1109/2246] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:49:12.191688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9c79-9b17-45bb-b866-344bc4b891f9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.192168 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9c79-9b17-45bb-b866-344bc4b891f9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.192386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9c79-9b17-45bb-b866-344bc4b891f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.227994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4f6c9c79-9b17-45bb-b866-344bc4b891f9 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:12.229269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4f6c9c79-9b17-45bb-b866-344bc4b891f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:12.316525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1138/2247] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:49:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:12.328049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91609c-a054-4c5e-ab65-0442cb2390b9 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:12.339481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91609c-a054-4c5e-ab65-0442cb2390b9 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:12.343002 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2603e33-a88a-47b0-b1dc-2523cc7fec41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:12.343582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603e33-a88a-47b0-b1dc-2523cc7fec41 service glance] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.343862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603e33-a88a-47b0-b1dc-2523cc7fec41 service glance] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.344128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603e33-a88a-47b0-b1dc-2523cc7fec41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.355290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2603e33-a88a-47b0-b1dc-2523cc7fec41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:12.356758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2603e33-a88a-47b0-b1dc-2523cc7fec41 service glance] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:12.367782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1110/2248] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:12.645759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5b2bb-b3f5-45f6-9ca9-c7b38a0f6963 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.646068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5b2bb-b3f5-45f6-9ca9-c7b38a0f6963 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.646344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5b2bb-b3f5-45f6-9ca9-c7b38a0f6963 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.647694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1139/2249] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:49:12.652216 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb72889-4618-452b-bb5f-a94036734ee4 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.652547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb72889-4618-452b-bb5f-a94036734ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.652891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb72889-4618-452b-bb5f-a94036734ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.673987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ebb72889-4618-452b-bb5f-a94036734ee4 None None] MFA Rules not processed for user `60e4cc87886d4b7788864eaf94334e22`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:12.675197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ebb72889-4618-452b-bb5f-a94036734ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:12.729690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1111/2250] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:49:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:12.741714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5b2bb-b3f5-45f6-9ca9-c7b38a0f6963 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:12.747053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0dc5b2bb-b3f5-45f6-9ca9-c7b38a0f6963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:12.757597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5b2bb-b3f5-45f6-9ca9-c7b38a0f6963 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:12.761147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2105a3e-aa47-466c-8d12-a8cadc4e8cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:12.761737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2105a3e-aa47-466c-8d12-a8cadc4e8cfb service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.762012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2105a3e-aa47-466c-8d12-a8cadc4e8cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.762289 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2105a3e-aa47-466c-8d12-a8cadc4e8cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.769407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2105a3e-aa47-466c-8d12-a8cadc4e8cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:12.770820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2105a3e-aa47-466c-8d12-a8cadc4e8cfb service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:12.780584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1140/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:49:12.867566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82903-f9ef-4139-a9f6-d04be0599ad2 None None] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.867871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82903-f9ef-4139-a9f6-d04be0599ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.868144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82903-f9ef-4139-a9f6-d04be0599ad2 None None] PATH_INFO: `/` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.869621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1112/2252] 10.222.0.39 () {54 vars in 921 bytes} [Wed Nov 2 07:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 07:49:12.874390 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97983-4cdc-4266-be60-ecaf3ced7610 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.874678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97983-4cdc-4266-be60-ecaf3ced7610 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.874949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa97983-4cdc-4266-be60-ecaf3ced7610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.895226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5fa97983-4cdc-4266-be60-ecaf3ced7610 None None] MFA Rules not processed for user `e5e6e7eee9ea4be093bb283594f7651c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:12.896500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5fa97983-4cdc-4266-be60-ecaf3ced7610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:12.906679 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1141/2253] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Nov 2 07:49:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:12.918138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e82903-f9ef-4139-a9f6-d04be0599ad2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:12.929092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e82903-f9ef-4139-a9f6-d04be0599ad2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:12.932650 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:12.933311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:12.933593 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:12.933864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:12.946108 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:12.947555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:12.958538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1113/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:15.477725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db436f-cc7d-4abc-b11c-c75f69581e50 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:15.478179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db436f-cc7d-4abc-b11c-c75f69581e50 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:15.478272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db436f-cc7d-4abc-b11c-c75f69581e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:15.498730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a3db436f-cc7d-4abc-b11c-c75f69581e50 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:15.499896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a3db436f-cc7d-4abc-b11c-c75f69581e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:15.505049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:15.558086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1142/2255] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:49:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:15.569915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:15.571350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:15.581142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:15.638884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6f6e7-7d37-4497-8ccc-025dac1fd97d service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:15.643943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:15.644564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:15.644876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:15.645250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:15.653263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:15.654834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:15.663903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1114/2256] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:49:25.660354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=20 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:25.792111 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=29 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:39.322152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90c485-1ffb-4cd1-a06d-2a86f85bbc01 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:39.322629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90c485-1ffb-4cd1-a06d-2a86f85bbc01 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:39.322768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90c485-1ffb-4cd1-a06d-2a86f85bbc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:39.342218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5d90c485-1ffb-4cd1-a06d-2a86f85bbc01 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:39.343389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5d90c485-1ffb-4cd1-a06d-2a86f85bbc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:39.350354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1143/2257] 10.222.0.39 () {58 vars in 967 bytes} [Wed Nov 2 07:49:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:39.363063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:39.373480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e27b08-2ddd-47be-8880-83e4be9ab82e service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:39.384037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfb392-de94-4c55-8171-689c346a54a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:39.384037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfb392-de94-4c55-8171-689c346a54a9 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:39.384037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfb392-de94-4c55-8171-689c346a54a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:39.384037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfb392-de94-4c55-8171-689c346a54a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:39.387935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfb392-de94-4c55-8171-689c346a54a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:39.389607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfb392-de94-4c55-8171-689c346a54a9 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:39.397459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1115/2258] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:49:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:49:43.169276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90c485-1ffb-4cd1-a06d-2a86f85bbc01 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.230792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90c485-1ffb-4cd1-a06d-2a86f85bbc01 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.235531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.236141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.236412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.236788 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] PATH_INFO: `/v3/users/8b23f760eaa24190a2d07716b5bdf147` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.237951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b23f760eaa24190a2d07716b5bdf147)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.239960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.422643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b23f760eaa24190a2d07716b5bdf147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:43.429554 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b23f760eaa24190a2d07716b5bdf147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:43.430186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b23f760eaa24190a2d07716b5bdf147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:43.431281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b23f760eaa24190a2d07716b5bdf147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:43.495041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b23f760eaa24190a2d07716b5bdf147'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:43.513441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1144/2259] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:49:43 2022] DELETE /identity/v3/users/8b23f760eaa24190a2d07716b5bdf147 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:43.517882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.518380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.518480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.538213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:43.539413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:43.596845 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1116/2260] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:43.606739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:43.608212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:43.671928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c815-9083-449f-816e-d2f17ef6a29e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:43.675758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad999c1b-1635-474e-b46b-efc6c4fca969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:43.676353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999c1b-1635-474e-b46b-efc6c4fca969 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:43.676655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999c1b-1635-474e-b46b-efc6c4fca969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:43.676921 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999c1b-1635-474e-b46b-efc6c4fca969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:43.687034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad999c1b-1635-474e-b46b-efc6c4fca969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:43.688647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad999c1b-1635-474e-b46b-efc6c4fca969 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:43.699268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1145/2261] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:44.113112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.114583 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:44.132127 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894a63-3b12-428e-9f8a-b0ced1e216cb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.136834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.137539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.137880 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.138213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] PATH_INFO: `/v3/projects/97b939cac0f7482d8c8986e942406513` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.139412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b939cac0f7482d8c8986e942406513)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.141489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.265865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b939cac0f7482d8c8986e942406513', 'request_id': 'req-f187f45c-5988-4b02-8b2e-3aca7aad817a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:44.272112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b939cac0f7482d8c8986e942406513', 'request_id': 'req-f187f45c-5988-4b02-8b2e-3aca7aad817a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:44.278237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b939cac0f7482d8c8986e942406513', 'request_id': 'req-f187f45c-5988-4b02-8b2e-3aca7aad817a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:44.351091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] The token cache is being invalidate because project 97b939cac0f7482d8c8986e942406513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:49:44.351376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:44.351995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-f187f45c-5988-4b02-8b2e-3aca7aad817a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:49:44.354124 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1117/2262] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:49:44 2022] DELETE /identity/v3/projects/97b939cac0f7482d8c8986e942406513 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:44.359001 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf1e91-cf8f-49ee-8006-63965dd8d094 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.359490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf1e91-cf8f-49ee-8006-63965dd8d094 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.359591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf1e91-cf8f-49ee-8006-63965dd8d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.378573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8fdf1e91-cf8f-49ee-8006-63965dd8d094 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:44.379761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8fdf1e91-cf8f-49ee-8006-63965dd8d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:44.388900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:44.438070 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1146/2263] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:44.445832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23950-e6a2-41c4-a6f4-f7df2c120004 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.446115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23950-e6a2-41c4-a6f4-f7df2c120004 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.446391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23950-e6a2-41c4-a6f4-f7df2c120004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.466518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a4e23950-e6a2-41c4-a6f4-f7df2c120004 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:44.467694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a4e23950-e6a2-41c4-a6f4-f7df2c120004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:44.475533 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1118/2264] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:44.480267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf1e91-cf8f-49ee-8006-63965dd8d094 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.490250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf1e91-cf8f-49ee-8006-63965dd8d094 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.495257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.495845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.496127 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.496392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.497063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:49:44.497366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.498953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.510569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1147/2265] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:49:44.514846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23950-e6a2-41c4-a6f4-f7df2c120004 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.523856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23950-e6a2-41c4-a6f4-f7df2c120004 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.529061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.529645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.529923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.530191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.530817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.532735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.644308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1119/2266] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:44 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:44.648403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.658702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2c5ae-b8ab-4fb3-9549-9603da451621 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.714110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.714795 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.715076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.715350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.715975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.717954 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.781456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1148/2267] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:44 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:44.785517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.795968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf857641-cfa7-42cf-8f1e-c2b006e3172d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.800589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.801172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.801448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.801722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.802412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.805297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.818249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1120/2268] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:49:44.819498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.830189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52122ab-9262-4c8a-a429-3d79e2d5a9c6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.834810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3694e-8afa-4d09-ad4b-6b36fa2e1f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.835389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3694e-8afa-4d09-ad4b-6b36fa2e1f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.835666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3694e-8afa-4d09-ad4b-6b36fa2e1f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.836019 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3694e-8afa-4d09-ad4b-6b36fa2e1f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.836583 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3694e-8afa-4d09-ad4b-6b36fa2e1f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.838778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3694e-8afa-4d09-ad4b-6b36fa2e1f2d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.852687 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1149/2269] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:44.853860 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:44.864165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950f28-10e1-49f2-97df-8795bbc510d3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:44.868904 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:44.869574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.869852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.870122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] PATH_INFO: `/v3/projects/3d5592e8f779405499305dd22a99768a/users/6d9ca005594b416e8009b25250144503/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:44.885612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5592e8f779405499305dd22a99768a, user_id=6d9ca005594b416e8009b25250144503, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:44.888263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:44.980823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1121/2270] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:44 2022] PUT /identity/v3/projects/3d5592e8f779405499305dd22a99768a/users/6d9ca005594b416e8009b25250144503/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:44.985873 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57edc2-d183-4eaa-8b22-4a12d57363b9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:44.986090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57edc2-d183-4eaa-8b22-4a12d57363b9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:44.986358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57edc2-d183-4eaa-8b22-4a12d57363b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:45.006232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8a57edc2-d183-4eaa-8b22-4a12d57363b9 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:45.007434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8a57edc2-d183-4eaa-8b22-4a12d57363b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:45.069466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1150/2271] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:45.079862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:45.081683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:45.091656 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:45.141303 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013b8fb-baab-464d-b7dc-88c066d94fe5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:45.145475 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:45.145820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:45.151761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:45.151761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:45.155910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:45.157351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:45.167829 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1122/2272] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:50.688095 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3b526-fbba-4f2a-8744-53e517dfdb89 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:50.688974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3b526-fbba-4f2a-8744-53e517dfdb89 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:50.689254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3b526-fbba-4f2a-8744-53e517dfdb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:50.721319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ccf3b526-fbba-4f2a-8744-53e517dfdb89 None None] MFA Rules not processed for user `6d9ca005594b416e8009b25250144503`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:50.722805 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ccf3b526-fbba-4f2a-8744-53e517dfdb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:50.734592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:50.796098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1151/2273] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:50.800602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:50.811956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc3875-4df9-47eb-9e1d-29e36b64911e service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:50.816609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:50.817197 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:50.817499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:50.817763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:50.818813 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:50.820872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:50.925592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1123/2274] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:49:50.929609 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3b526-fbba-4f2a-8744-53e517dfdb89 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:50.941650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3b526-fbba-4f2a-8744-53e517dfdb89 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:50.999394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:50.999992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:51.000268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:51.000573 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:51.001196 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:51.003086 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:51.129653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1152/2275] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:49:50 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:49:51.133412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:51.144305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461807c-8dad-4f9e-bd73-f53565040123 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:51.148917 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:51.149534 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:51.149809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:51.150071 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:51.150702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:51.152324 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:51.163239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1124/2276] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:51.167387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:51.177719 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72f3f2-4c9f-4db0-b816-a059640a9f7e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:51.182769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:51.183416 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:51.183717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:51.183986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] PATH_INFO: `/v3/projects/9b840fb7d28b4ead90c3affe1ec00d77/users/aaf530720c744d5894d50a50424dd1cd/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:51.200057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b840fb7d28b4ead90c3affe1ec00d77, user_id=aaf530720c744d5894d50a50424dd1cd, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:51.202882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:51.270067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1153/2277] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:51 2022] PUT /identity/v3/projects/9b840fb7d28b4ead90c3affe1ec00d77/users/aaf530720c744d5894d50a50424dd1cd/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:51.271393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:51.282056 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de9be-016c-4600-994b-4c89d24d9496 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:51.361573 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d8db-a0cf-46e4-8ce9-65bca9480343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:51.362290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d8db-a0cf-46e4-8ce9-65bca9480343 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:51.362630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d8db-a0cf-46e4-8ce9-65bca9480343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:51.362962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d8db-a0cf-46e4-8ce9-65bca9480343 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:51.363667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d8db-a0cf-46e4-8ce9-65bca9480343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:51.365363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d8db-a0cf-46e4-8ce9-65bca9480343 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:51.376541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1125/2278] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:49:51.380594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:51.390840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee8b5-e8f1-46c0-a32c-99e99fbb349a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:51.395357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:51.395999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:51.396273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:51.396569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] PATH_INFO: `/v3/projects/9b840fb7d28b4ead90c3affe1ec00d77/users/aaf530720c744d5894d50a50424dd1cd/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:51.398502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b840fb7d28b4ead90c3affe1ec00d77, user_id=aaf530720c744d5894d50a50424dd1cd, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:51.401191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:51.412165 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1154/2279] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:49:51 2022] PUT /identity/v3/projects/9b840fb7d28b4ead90c3affe1ec00d77/users/aaf530720c744d5894d50a50424dd1cd/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:49:57.428700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e872a-3123-4324-9de9-c5dbe89f9c5e None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:57.429226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e872a-3123-4324-9de9-c5dbe89f9c5e None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:57.429226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e872a-3123-4324-9de9-c5dbe89f9c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:57.459760 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-ae4e872a-3123-4324-9de9-c5dbe89f9c5e None None] MFA Rules not processed for user `aaf530720c744d5894d50a50424dd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:57.461574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ae4e872a-3123-4324-9de9-c5dbe89f9c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:57.527211 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:57.532264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1126/2280] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:49:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:57.545273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:57.547009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:57.607101 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d94c4-f55f-44cf-b51e-aeefe5040f34 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:57.610702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ea11e310224282b38a0822fbbcf40a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:57.611302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:57.611576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:57.611845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:57.628548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:49:57.668425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:57.669889 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:57.679102 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1155/2281] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:49:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:49:57.997946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:57.999866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:57.999866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:58.019828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:49:58.021971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:58.082740 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1127/2282] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:49:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:49:58.105299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:49:58.109075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:49:58.183399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29928d6a-07b9-4302-966e-6b385ebe1691 service glance] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:49:58.188563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:49:58.189227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:49:58.189507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:49:58.189781 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:49:58.198124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:49:58.199708 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:49:58.208479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1156/2283] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:50:01.200609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:01.202135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:01.273152 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93f0bc-0276-4364-a404-c053595e60ae None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:01.278426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:01.279058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:01.279481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:01.279752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:01.281524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:01.351571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:01.353679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:01.364072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1128/2284] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:06.152840 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:06.154281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:06.170804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af9dd6-2363-4945-8f1a-b9f794f947ad service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:06.179495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:06.179495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:06.179495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:06.179495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] PATH_INFO: `/v3/users/207560d0ab0b4fe0bae750ac180f37bf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:06.180201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=207560d0ab0b4fe0bae750ac180f37bf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:06.181207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:06.376336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207560d0ab0b4fe0bae750ac180f37bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:06.385139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207560d0ab0b4fe0bae750ac180f37bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:06.385917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207560d0ab0b4fe0bae750ac180f37bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:06.386607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207560d0ab0b4fe0bae750ac180f37bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:06.462822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5dec57ad-bf33-4dde-897b-592370e33e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207560d0ab0b4fe0bae750ac180f37bf'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:06.486894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1157/2285] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:06 2022] DELETE /identity/v3/users/207560d0ab0b4fe0bae750ac180f37bf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:06.749920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:06.762354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347489af-c4f6-433d-b27f-b95a7ea31cea service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:06.848594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=100 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:06.864662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:06.865592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:06.866041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:06.866451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] PATH_INFO: `/v3/projects/b3225bb01e8c4b2aa7225739b3f25a8d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:06.867862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3225bb01e8c4b2aa7225739b3f25a8d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:06.870421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:06.984978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3225bb01e8c4b2aa7225739b3f25a8d', 'request_id': 'req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:06.998785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3225bb01e8c4b2aa7225739b3f25a8d', 'request_id': 'req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.001856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3225bb01e8c4b2aa7225739b3f25a8d', 'request_id': 'req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.077571 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] The token cache is being invalidate because project b3225bb01e8c4b2aa7225739b3f25a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:07.078145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.079114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4b81bdbb-b519-4c83-b4bd-7a80a69e4f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:07.081836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1129/2286] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:06 2022] DELETE /identity/v3/projects/b3225bb01e8c4b2aa7225739b3f25a8d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:07.085632 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827e27-00f2-4010-953f-7193776d4644 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.085923 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827e27-00f2-4010-953f-7193776d4644 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.086198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827e27-00f2-4010-953f-7193776d4644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.107843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-72827e27-00f2-4010-953f-7193776d4644 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:07.109091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-72827e27-00f2-4010-953f-7193776d4644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:07.127279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:07.184271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1158/2287] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:07.193059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977128-a6e8-4745-aa42-fa5452d60621 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.193340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977128-a6e8-4745-aa42-fa5452d60621 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.193652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977128-a6e8-4745-aa42-fa5452d60621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.215416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f4977128-a6e8-4745-aa42-fa5452d60621 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:07.216740 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f4977128-a6e8-4745-aa42-fa5452d60621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:07.228539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1130/2288] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:50:07.230009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827e27-00f2-4010-953f-7193776d4644 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.240582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827e27-00f2-4010-953f-7193776d4644 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.245754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.246357 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.246631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.246901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.247541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:50:07.247843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.249526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:07.266893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1159/2289] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:50:07.270343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4977128-a6e8-4745-aa42-fa5452d60621 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.292562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4977128-a6e8-4745-aa42-fa5452d60621 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.297564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.298166 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.298442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.298709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.299335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.301442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:07.417935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1131/2290] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:07 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:07.421969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.432254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ddbd-befc-4f11-aaaf-eb4383b30c24 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.501586 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.502221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.502567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.503154 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.504312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.506355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:07.585959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1160/2291] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:07 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:07.591483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.602300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d76e2-9761-4577-8dc5-9219528943d2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.607688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.608392 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.608794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.609164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.609861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.612017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:07.623341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1132/2292] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:50:07.627353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.639751 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0abd4-7d90-4ef0-b277-d41b5cb82eba admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.645926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938c46-fa19-4b32-b179-3dd170ac2c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.645926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938c46-fa19-4b32-b179-3dd170ac2c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.646176 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938c46-fa19-4b32-b179-3dd170ac2c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.646675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938c46-fa19-4b32-b179-3dd170ac2c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.647560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938c46-fa19-4b32-b179-3dd170ac2c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.649188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938c46-fa19-4b32-b179-3dd170ac2c0f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:07.660823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1161/2293] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:07.666001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.677637 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2f754-f521-4a1e-897a-6011c0aa65c2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.683250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.683932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.686509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.686509 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] PATH_INFO: `/v3/projects/af69474d892c4179af2f6bb5217e1cb1/users/9fdcfacce0f04b0a941c016c8e19be28/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.704322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af69474d892c4179af2f6bb5217e1cb1, user_id=9fdcfacce0f04b0a941c016c8e19be28, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.707078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:07.781185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1133/2294] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:07 2022] PUT /identity/v3/projects/af69474d892c4179af2f6bb5217e1cb1/users/9fdcfacce0f04b0a941c016c8e19be28/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:07.786330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab54b0-e0c4-422e-8fcb-6ef0ee720289 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.786678 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab54b0-e0c4-422e-8fcb-6ef0ee720289 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.786957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab54b0-e0c4-422e-8fcb-6ef0ee720289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.808992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-02ab54b0-e0c4-422e-8fcb-6ef0ee720289 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:07.810212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-02ab54b0-e0c4-422e-8fcb-6ef0ee720289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:07.885084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1162/2295] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:50:07.907176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:07.909149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:07.978426 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e94e-861d-4c52-b147-ec34b6882b61 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:07.984589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:07.985205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:07.985634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:07.985907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:07.995934 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:07.997464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:08.008379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1134/2296] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:09.678074 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6cadc-4876-4575-bb18-92eb843bbc68 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:09.678643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6cadc-4876-4575-bb18-92eb843bbc68 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:09.678643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6cadc-4876-4575-bb18-92eb843bbc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:09.704020 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-40a6cadc-4876-4575-bb18-92eb843bbc68 None None] MFA Rules not processed for user `6d9ca005594b416e8009b25250144503`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:09.705685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-40a6cadc-4876-4575-bb18-92eb843bbc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:09.729563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:09.766317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1163/2297] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:10.154257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:10.156326 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:10.190076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:10.260559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c7211-8e2d-4aff-821f-0622b7db42ab service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:10.266240 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:10.266951 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:10.267388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:10.267741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:10.270553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:10.284045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:10.285958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:10.307459 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1135/2298] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:13.785918 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6da8-3400-43d0-b768-cb4328000793 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:13.786734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6da8-3400-43d0-b768-cb4328000793 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:13.786734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6da8-3400-43d0-b768-cb4328000793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:13.809037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cc2d6da8-3400-43d0-b768-cb4328000793 None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:13.810498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc2d6da8-3400-43d0-b768-cb4328000793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:13.897584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1164/2299] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Nov 2 07:50:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:13.913128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:13.915843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:14.002078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aa0e9-b31e-4b5c-ad46-fb4ffbac1c50 service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:14.007318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:14.007966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:14.008242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:14.008660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:14.018393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:14.020363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:14.037952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1136/2300] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:50:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 07:50:14.446804 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a83378-f76a-4966-b797-d5af8c7857af None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:14.448137 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a83378-f76a-4966-b797-d5af8c7857af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:14.448611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a83378-f76a-4966-b797-d5af8c7857af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:14.499963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b0a83378-f76a-4966-b797-d5af8c7857af None None] MFA Rules not processed for user `9fdcfacce0f04b0a941c016c8e19be28`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:14.504617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b0a83378-f76a-4966-b797-d5af8c7857af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:14.654532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1165/2301] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:14.673703 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:14.675700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:14.798376 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf80daf-8ab2-4923-912c-d082230ae061 service swift] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:14.809457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:14.810182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:14.811423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:14.811803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:14.831720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:14.834162 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:14.849591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1137/2302] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:18.086304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad366dd-24a9-4b78-bb62-b8cd8e46bd6f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:18.086836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad366dd-24a9-4b78-bb62-b8cd8e46bd6f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:18.087001 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad366dd-24a9-4b78-bb62-b8cd8e46bd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:18.127556 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6ad366dd-24a9-4b78-bb62-b8cd8e46bd6f None None] MFA Rules not processed for user `9fdcfacce0f04b0a941c016c8e19be28`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:18.131406 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6ad366dd-24a9-4b78-bb62-b8cd8e46bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:18.139624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1166/2303] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:24.842020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:28.114378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=73 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:43.861178 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:43.862612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:43.874454 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd877a-f036-4ab6-909c-c0be7fafcdc9 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:43.878051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:43.878661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:43.879044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:43.879317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:43.881005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:43.942780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:43.944187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:43.954075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1138/2304] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:53.684319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad366dd-24a9-4b78-bb62-b8cd8e46bd6f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:53.697600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad366dd-24a9-4b78-bb62-b8cd8e46bd6f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:53.701780 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:53.702377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:53.702685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:53.702956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:53.704722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:53.720276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:53.721802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:53.731713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1167/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:53.949832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=30 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:57.196749 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:57.198208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:57.212747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f1e07-aada-43da-9cd3-a19e16aa690a service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:57.218391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:57.218983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:57.219316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:57.219594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:57.221308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:57.232851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:57.234455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:57.244419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1139/2306] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:57.336553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:57.338404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:57.352473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037b3ee-da93-499d-b46d-d115c03cbdc2 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:57.357212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:57.357826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:57.358099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:57.358365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] PATH_INFO: `/v3/users/86f173866b014ce69c82c6c2eed4c719` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:57.359459 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f173866b014ce69c82c6c2eed4c719)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:57.361400 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:57.542100 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f173866b014ce69c82c6c2eed4c719'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:57.548926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f173866b014ce69c82c6c2eed4c719'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:57.549648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f173866b014ce69c82c6c2eed4c719'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:57.550244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f173866b014ce69c82c6c2eed4c719'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:57.608046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5390227c-077c-441e-a4a5-8572c91a8c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f173866b014ce69c82c6c2eed4c719'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:57.626604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1168/2307] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:50:57 2022] DELETE /identity/v3/users/86f173866b014ce69c82c6c2eed4c719 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:57.878723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:57.889830 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607218c-a39c-48f6-b5ee-4c36fe241f15 service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:57.946335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:57.946947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:57.947220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:57.947489 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] PATH_INFO: `/v3/projects/9b17cef9bee64114bec02b682359ead7` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:57.948616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b17cef9bee64114bec02b682359ead7)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:57.950507 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:58.054664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b17cef9bee64114bec02b682359ead7', 'request_id': 'req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:58.061419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b17cef9bee64114bec02b682359ead7', 'request_id': 'req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:58.066928 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b17cef9bee64114bec02b682359ead7', 'request_id': 'req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:58.138672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] The token cache is being invalidate because project 9b17cef9bee64114bec02b682359ead7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:50:58.138961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:58.139589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-434e0d3f-0a3d-422c-a07c-dbda15dc67eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:50:58.141120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1140/2308] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:50:57 2022] DELETE /identity/v3/projects/9b17cef9bee64114bec02b682359ead7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:58.146094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6feac-64db-4eeb-b29d-2f2925a037dc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.146384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6feac-64db-4eeb-b29d-2f2925a037dc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.146664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6feac-64db-4eeb-b29d-2f2925a037dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.166495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b7f6feac-64db-4eeb-b29d-2f2925a037dc None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:58.168191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b7f6feac-64db-4eeb-b29d-2f2925a037dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:58.225532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1169/2309] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:58.233781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f964869-e7c3-4455-bd6b-eab3e4f98fcf None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.234248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f964869-e7c3-4455-bd6b-eab3e4f98fcf None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.234362 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f964869-e7c3-4455-bd6b-eab3e4f98fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.254310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0f964869-e7c3-4455-bd6b-eab3e4f98fcf None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:58.255490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0f964869-e7c3-4455-bd6b-eab3e4f98fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:58.263202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1141/2310] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:58.267345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6feac-64db-4eeb-b29d-2f2925a037dc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:58.276987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6feac-64db-4eeb-b29d-2f2925a037dc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:58.281595 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:58.282208 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.282487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.282759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.283403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:50:58.283706 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:58.285343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:58.297446 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1170/2311] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:50:58.301681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f964869-e7c3-4455-bd6b-eab3e4f98fcf None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:58.311328 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f964869-e7c3-4455-bd6b-eab3e4f98fcf None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:58.315897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:58.316513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.316795 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.317067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.317691 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:58.319636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:58.404262 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1142/2312] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:58 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:58.408355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:58.419120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a978f-cc67-4f5a-a127-5a2cf56e7767 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:58.461392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:58.474499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:58.475140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.475467 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.475739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.476388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:58.478368 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:58.543710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1171/2313] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:58 2022] POST /identity/v3/users => generated 278 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:50:58.545054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:58.555373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014cc33-da8d-4ec1-8651-104175537a63 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:58.560259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:58.569063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.569063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.569063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.569063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:58.569063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:58.574393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1143/2314] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:58.578307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:58.589021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1c16e-af7b-4315-b8f9-c5578b0cd499 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:58.595550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c733e-3b2c-44d0-be6a-0c5526556f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:58.596163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c733e-3b2c-44d0-be6a-0c5526556f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.596464 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c733e-3b2c-44d0-be6a-0c5526556f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.596725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c733e-3b2c-44d0-be6a-0c5526556f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.597363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c733e-3b2c-44d0-be6a-0c5526556f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:58.599092 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c733e-3b2c-44d0-be6a-0c5526556f3f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:58.610820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1172/2315] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:50:58.615848 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:58.626697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4297137-4227-4f2e-ad99-b8dee7b741f0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:58.631311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:58.632033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.632372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.632761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] PATH_INFO: `/v3/projects/19a33a78d3764e309eafd9f2941762a1/users/dffd5e95e1cf4d6c96f5f1804e0f871b/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.647408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a33a78d3764e309eafd9f2941762a1, user_id=dffd5e95e1cf4d6c96f5f1804e0f871b, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:58.651022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:58.706177 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1144/2316] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:58 2022] PUT /identity/v3/projects/19a33a78d3764e309eafd9f2941762a1/users/dffd5e95e1cf4d6c96f5f1804e0f871b/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:58.718375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccf13a-058e-4344-80a3-e0fa1aa7360c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.718653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccf13a-058e-4344-80a3-e0fa1aa7360c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.718942 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccf13a-058e-4344-80a3-e0fa1aa7360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.746338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bfccf13a-058e-4344-80a3-e0fa1aa7360c None None] MFA Rules not processed for user `dffd5e95e1cf4d6c96f5f1804e0f871b`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:58.747518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bfccf13a-058e-4344-80a3-e0fa1aa7360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:58.811499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1173/2317] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:58.816133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:58.829768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:58.876709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd84a0-c487-4b17-8488-bfb8db52cb2e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:58.881501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:58.882308 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:58.882932 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:58.883295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:58.883930 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:58.885844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.049126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1145/2318] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:50:58 2022] POST /identity/v3/projects => generated 355 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:59.053337 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccf13a-058e-4344-80a3-e0fa1aa7360c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:59.064450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccf13a-058e-4344-80a3-e0fa1aa7360c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:59.119398 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:59.120290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.121330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.121769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.122569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:59.124488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.225220 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1174/2319] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:50:59 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:50:59.234498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:59.244981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a9a32-acf3-40a0-83f6-4d04ff57a0d8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:59.250098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:59.250683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.250959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.251227 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.251861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:59.253487 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.263686 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1146/2320] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:59.267924 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:59.277946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dfe7f-45ef-44ba-8dbf-782df9609106 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:59.282532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:59.283170 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.283450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.283722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] PATH_INFO: `/v3/projects/f74f56b1454147d7bb1526e9f550ca66/users/0dc7e7a73c434a30b3fed114cd0e6137/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.298651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74f56b1454147d7bb1526e9f550ca66, user_id=0dc7e7a73c434a30b3fed114cd0e6137, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:59.301401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.356420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1175/2321] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:59 2022] PUT /identity/v3/projects/f74f56b1454147d7bb1526e9f550ca66/users/0dc7e7a73c434a30b3fed114cd0e6137/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:59.360570 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:59.370980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736bfe8-5ea7-4d0a-9847-f6c963dc0722 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:59.427453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259cab2-7edb-4a2c-8c87-ba92febb8f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:59.428041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259cab2-7edb-4a2c-8c87-ba92febb8f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.428312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259cab2-7edb-4a2c-8c87-ba92febb8f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.428612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259cab2-7edb-4a2c-8c87-ba92febb8f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.429232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259cab2-7edb-4a2c-8c87-ba92febb8f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:59.430803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259cab2-7edb-4a2c-8c87-ba92febb8f12 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.440944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1147/2322] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:50:59.445268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:59.455494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2014a78-30c7-435a-8b9c-2630c489c466 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:59.460088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:59.460755 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.461030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.461297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] PATH_INFO: `/v3/projects/f74f56b1454147d7bb1526e9f550ca66/users/0dc7e7a73c434a30b3fed114cd0e6137/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.463188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74f56b1454147d7bb1526e9f550ca66, user_id=0dc7e7a73c434a30b3fed114cd0e6137, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:59.465883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.475775 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1176/2323] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:50:59 2022] PUT /identity/v3/projects/f74f56b1454147d7bb1526e9f550ca66/users/0dc7e7a73c434a30b3fed114cd0e6137/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:50:59.486408 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190cca-1994-4179-a714-a3b325fc9f7f None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.486689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190cca-1994-4179-a714-a3b325fc9f7f None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.486986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190cca-1994-4179-a714-a3b325fc9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.514232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-4a190cca-1994-4179-a714-a3b325fc9f7f None None] MFA Rules not processed for user `0dc7e7a73c434a30b3fed114cd0e6137`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:50:59.515409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4a190cca-1994-4179-a714-a3b325fc9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:59.582046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1148/2324] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:50:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:50:59.593412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:59.595099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:50:59.605297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:59.652460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d2141-e5b7-4e24-9400-5724ea786647 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:59.656081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:59.656702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.656979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.657246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.666668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:59.668643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.677900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1177/2325] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:50:59.896834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a190cca-1994-4179-a714-a3b325fc9f7f None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:50:59.906920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a190cca-1994-4179-a714-a3b325fc9f7f None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:50:59.910415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb843734-b8ed-46ca-9743-146bffa6877d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:50:59.910997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843734-b8ed-46ca-9743-146bffa6877d service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:50:59.911268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843734-b8ed-46ca-9743-146bffa6877d service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:50:59.911536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843734-b8ed-46ca-9743-146bffa6877d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:50:59.916759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:50:59.966709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb843734-b8ed-46ca-9743-146bffa6877d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:50:59.968471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb843734-b8ed-46ca-9743-146bffa6877d service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:50:59.977662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1149/2326] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:50:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:09.673701 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=23 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:09.973646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=24 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:18.839326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:18.900010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bc308-56cb-498e-b4a2-e1b75ba99d70 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:18.904625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:18.905189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:18.905466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:18.905733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] PATH_INFO: `/v3/users/dffd5e95e1cf4d6c96f5f1804e0f871b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:18.906829 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffd5e95e1cf4d6c96f5f1804e0f871b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:18.908766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:19.066862 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffd5e95e1cf4d6c96f5f1804e0f871b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.074188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffd5e95e1cf4d6c96f5f1804e0f871b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.074847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffd5e95e1cf4d6c96f5f1804e0f871b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.075486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffd5e95e1cf4d6c96f5f1804e0f871b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.133508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffd5e95e1cf4d6c96f5f1804e0f871b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.152369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1178/2327] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:18 2022] DELETE /identity/v3/users/dffd5e95e1cf4d6c96f5f1804e0f871b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:19.157006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:19.157469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:19.157469 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:19.176897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:19.178737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:19.235388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1150/2328] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:19.245619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:19.246983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:19.303675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621de49-5aa9-4571-bead-7b79f78b2831 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:19.307461 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:19.308055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:19.308335 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:19.308637 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:19.317677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:19.319132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:19.328495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1179/2329] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:19.706434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:19.708004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:19.720412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94463ff-7f43-48b8-a93c-dbb50f287f50 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:19.725653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:19.726981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:19.727259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:19.727658 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] PATH_INFO: `/v3/projects/19a33a78d3764e309eafd9f2941762a1` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:19.728812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a33a78d3764e309eafd9f2941762a1)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:19.730715 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:19.824907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a33a78d3764e309eafd9f2941762a1', 'request_id': 'req-4c8d62d6-34a7-4094-8a48-18b5b597307b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.831059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a33a78d3764e309eafd9f2941762a1', 'request_id': 'req-4c8d62d6-34a7-4094-8a48-18b5b597307b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.837421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a33a78d3764e309eafd9f2941762a1', 'request_id': 'req-4c8d62d6-34a7-4094-8a48-18b5b597307b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.899680 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] The token cache is being invalidate because project 19a33a78d3764e309eafd9f2941762a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:19.900042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.900610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:19.902109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1151/2330] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:19 2022] DELETE /identity/v3/projects/19a33a78d3764e309eafd9f2941762a1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:19.906111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:19.915852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c171857-ea81-4355-8648-5792435e7e35 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:19.933577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:19.970514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:19.971063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:19.971340 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:19.971603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] PATH_INFO: `/v3/users/0dc7e7a73c434a30b3fed114cd0e6137` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:19.972892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc7e7a73c434a30b3fed114cd0e6137)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:19.975542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.187171 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc7e7a73c434a30b3fed114cd0e6137'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:20.194139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc7e7a73c434a30b3fed114cd0e6137'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:20.194786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc7e7a73c434a30b3fed114cd0e6137'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:20.195378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc7e7a73c434a30b3fed114cd0e6137'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:20.264769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8dc3c115-750b-4d56-92c3-9f23d4032c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc7e7a73c434a30b3fed114cd0e6137'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:20.282512 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1180/2331] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:19 2022] DELETE /identity/v3/users/0dc7e7a73c434a30b3fed114cd0e6137 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:20.688550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:20.689971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:20.704794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d62d6-34a7-4094-8a48-18b5b597307b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:20.761271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:20.761914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:20.762188 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:20.762456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] PATH_INFO: `/v3/projects/f74f56b1454147d7bb1526e9f550ca66` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:20.763553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74f56b1454147d7bb1526e9f550ca66)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:20.765501 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:20.895722 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:20.912671 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74f56b1454147d7bb1526e9f550ca66', 'request_id': 'req-27f60131-b891-41eb-ab07-44e3639de132'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:20.919130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74f56b1454147d7bb1526e9f550ca66', 'request_id': 'req-27f60131-b891-41eb-ab07-44e3639de132'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:20.924660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74f56b1454147d7bb1526e9f550ca66', 'request_id': 'req-27f60131-b891-41eb-ab07-44e3639de132'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:21.097761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] The token cache is being invalidate because project f74f56b1454147d7bb1526e9f550ca66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:21.098529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:21.098638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-27f60131-b891-41eb-ab07-44e3639de132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:21.100149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1152/2332] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:20 2022] DELETE /identity/v3/projects/f74f56b1454147d7bb1526e9f550ca66 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:21.105159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d0f-ee36-48ce-b752-419c551d79ff None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.105613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d0f-ee36-48ce-b752-419c551d79ff None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.105707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e72d0f-ee36-48ce-b752-419c551d79ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.128167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-05e72d0f-ee36-48ce-b752-419c551d79ff None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:21.129428 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-05e72d0f-ee36-48ce-b752-419c551d79ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:21.187431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1181/2333] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:21.197144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba6a39-9583-4236-88bb-ca080f22e3f3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.197449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba6a39-9583-4236-88bb-ca080f22e3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.197719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba6a39-9583-4236-88bb-ca080f22e3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.217451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-e2ba6a39-9583-4236-88bb-ca080f22e3f3 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:21.218628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e2ba6a39-9583-4236-88bb-ca080f22e3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:21.226353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1153/2334] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:21.230627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e72d0f-ee36-48ce-b752-419c551d79ff None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:21.241042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e72d0f-ee36-48ce-b752-419c551d79ff None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:21.245664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:21.246273 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.246533 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.246799 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.247441 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:51:21.247734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:21.249403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:21.261399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1182/2335] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:51:21.265606 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba6a39-9583-4236-88bb-ca080f22e3f3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:21.274960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba6a39-9583-4236-88bb-ca080f22e3f3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:21.279517 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:21.280130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.280530 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.280782 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.281413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:21.283290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:21.379948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1154/2336] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:21 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:21.384255 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:21.394018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407d1bd-94bd-42f5-b631-0783e52006db admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:21.420855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:21.450680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:21.451317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.451591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.451860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.452514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:21.454417 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:21.550050 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1183/2337] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:21 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:51:21.554221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:21.564798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139884-bedf-462a-b529-dfc8d8934914 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:21.569960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:21.570541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.570820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.571092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.572335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:21.573956 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:21.583743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1155/2338] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:21.588145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:21.597976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237f8f1-d64a-4944-992b-5fb6670d8599 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:21.602478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d5ac7-1ce3-4e43-a2c6-47a72a82485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:21.603061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d5ac7-1ce3-4e43-a2c6-47a72a82485c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.603332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d5ac7-1ce3-4e43-a2c6-47a72a82485c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.603597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d5ac7-1ce3-4e43-a2c6-47a72a82485c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.604221 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d5ac7-1ce3-4e43-a2c6-47a72a82485c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:21.605820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d5ac7-1ce3-4e43-a2c6-47a72a82485c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:21.616097 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1184/2339] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:51:21.620006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:21.630494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d68d25-b481-4ea6-b560-3177dd314466 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:21.635596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:21.636228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.636543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.636820 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] PATH_INFO: `/v3/projects/8513731cf4644d82ac58c4c301926b53/users/a3fa874fdb954218b739874fbdb3cb08/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.652149 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8513731cf4644d82ac58c4c301926b53, user_id=a3fa874fdb954218b739874fbdb3cb08, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:21.654833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:21.727630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1156/2340] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:21 2022] PUT /identity/v3/projects/8513731cf4644d82ac58c4c301926b53/users/a3fa874fdb954218b739874fbdb3cb08/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:21.746790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a33d-7b66-4516-bbdd-00d33347e4b5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.747077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a33d-7b66-4516-bbdd-00d33347e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.747344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a33d-7b66-4516-bbdd-00d33347e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.774879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-11d2a33d-7b66-4516-bbdd-00d33347e4b5 None None] MFA Rules not processed for user `a3fa874fdb954218b739874fbdb3cb08`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:21.776066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-11d2a33d-7b66-4516-bbdd-00d33347e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:21.839732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1185/2341] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:21.844592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:21.907484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5345-cb91-42c8-80f1-645b133a857c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:21.912588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:21.913180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:21.913456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:21.913721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:21.914346 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:21.916233 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:22.014367 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1157/2342] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:21 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:22.018525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a33d-7b66-4516-bbdd-00d33347e4b5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:22.029786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a33d-7b66-4516-bbdd-00d33347e4b5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:22.086466 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:22.087067 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:22.087347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:22.087617 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:22.088246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:22.090192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:22.173636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1186/2343] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:22 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:51:22.177661 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:22.187907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb2154-cc5c-4540-ba30-c413746edd1d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:22.192516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:22.193609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:22.193889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:22.194156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:22.194784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:22.196365 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:22.206695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1158/2344] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:22.211290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:22.221068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626c8e1-001f-4a9a-a083-5f75fb0e45b7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:22.226063 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:22.226692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:22.226970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:22.227244 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] PATH_INFO: `/v3/projects/5a33740d49ff43638773eb55e83390f1/users/85974786702245a6b08a57b3d96d8794/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:22.242225 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a33740d49ff43638773eb55e83390f1, user_id=85974786702245a6b08a57b3d96d8794, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:22.244909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:22.322046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1187/2345] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:22 2022] PUT /identity/v3/projects/5a33740d49ff43638773eb55e83390f1/users/85974786702245a6b08a57b3d96d8794/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:51:22.326214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:22.336268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a7bc9-e4ff-4672-8722-001e7731fcd5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:22.356134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:22.391954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0ce28-1f13-4d36-8e4a-2122fa25fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:22.392582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0ce28-1f13-4d36-8e4a-2122fa25fa22 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:22.392863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0ce28-1f13-4d36-8e4a-2122fa25fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:22.393137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0ce28-1f13-4d36-8e4a-2122fa25fa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:22.393770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0ce28-1f13-4d36-8e4a-2122fa25fa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:22.395358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0ce28-1f13-4d36-8e4a-2122fa25fa22 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:22.404836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1159/2346] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:22.408965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:22.414995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:22.420257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1807b8-7d02-46ce-bc21-67c5f6f98947 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:22.427091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:22.427091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:22.427091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:22.427091 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] PATH_INFO: `/v3/projects/5a33740d49ff43638773eb55e83390f1/users/85974786702245a6b08a57b3d96d8794/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:22.428887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a33740d49ff43638773eb55e83390f1, user_id=85974786702245a6b08a57b3d96d8794, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:22.431548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:22.441608 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1188/2347] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:22 2022] PUT /identity/v3/projects/5a33740d49ff43638773eb55e83390f1/users/85974786702245a6b08a57b3d96d8794/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:22.451719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0de2-59d2-4f91-b2eb-3112c52baafe None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:22.452007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0de2-59d2-4f91-b2eb-3112c52baafe None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:22.452284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0de2-59d2-4f91-b2eb-3112c52baafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:22.480626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7b0a0de2-59d2-4f91-b2eb-3112c52baafe None None] MFA Rules not processed for user `85974786702245a6b08a57b3d96d8794`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:22.481828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7b0a0de2-59d2-4f91-b2eb-3112c52baafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:22.549496 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1160/2348] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:22.560463 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:22.562777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:22.620126 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9e2ac-7a24-4e86-b6e7-ddfccf835f5d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:22.623723 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df430547-23c6-4c93-8c58-87f875a17b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:22.624314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430547-23c6-4c93-8c58-87f875a17b8e service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:22.624615 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430547-23c6-4c93-8c58-87f875a17b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:22.624882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df430547-23c6-4c93-8c58-87f875a17b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:22.633988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df430547-23c6-4c93-8c58-87f875a17b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:22.635495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df430547-23c6-4c93-8c58-87f875a17b8e service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:22.644934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1189/2349] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:25.686554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0de2-59d2-4f91-b2eb-3112c52baafe None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:25.747612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0de2-59d2-4f91-b2eb-3112c52baafe None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:25.752019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:25.752668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:25.752947 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:25.753215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] PATH_INFO: `/v3/users/a3fa874fdb954218b739874fbdb3cb08` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:25.754312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fa874fdb954218b739874fbdb3cb08)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:25.756834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:25.968835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fa874fdb954218b739874fbdb3cb08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:25.969484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fa874fdb954218b739874fbdb3cb08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:25.970579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:25.981989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fa874fdb954218b739874fbdb3cb08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:25.988853 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fa874fdb954218b739874fbdb3cb08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:26.110805 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fa874fdb954218b739874fbdb3cb08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:26.117697 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1161/2350] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:25 2022] DELETE /identity/v3/users/a3fa874fdb954218b739874fbdb3cb08 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:26.122206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:26.124023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:26.124023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:26.141768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:26.142956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:26.201393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1190/2351] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:51:26.211499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:26.212949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:26.267989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888a7fd-6434-4eab-8283-f09dc8a177bc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:26.272017 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:26.272630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:26.272911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:26.273181 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:26.281872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:26.283288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:26.293311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1162/2352] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:26.677675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:26.687688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:26.691360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482fe22-f904-4854-9576-c35c35769ec6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:26.696730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:26.697361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:26.697641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:26.697912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] PATH_INFO: `/v3/projects/8513731cf4644d82ac58c4c301926b53` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:26.699018 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8513731cf4644d82ac58c4c301926b53)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:26.700975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:26.791246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8513731cf4644d82ac58c4c301926b53', 'request_id': 'req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:26.796685 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8513731cf4644d82ac58c4c301926b53', 'request_id': 'req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:26.802852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8513731cf4644d82ac58c4c301926b53', 'request_id': 'req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:26.908883 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] The token cache is being invalidate because project 8513731cf4644d82ac58c4c301926b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:26.909167 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:26.909766 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:26.911425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1191/2353] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:26 2022] DELETE /identity/v3/projects/8513731cf4644d82ac58c4c301926b53 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:26.915843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:26.925325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de823-d910-4e19-a2f7-1978d8504414 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:26.980632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:26.981380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:26.981654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:26.982027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] PATH_INFO: `/v3/users/85974786702245a6b08a57b3d96d8794` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:26.983118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85974786702245a6b08a57b3d96d8794)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:26.985061 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:27.158744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85974786702245a6b08a57b3d96d8794'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:27.159434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85974786702245a6b08a57b3d96d8794'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:27.171615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85974786702245a6b08a57b3d96d8794'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:27.176043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:27.179552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85974786702245a6b08a57b3d96d8794'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:27.275996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-63aa12d1-6e82-48cb-baba-106c5de1da0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85974786702245a6b08a57b3d96d8794'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:27.282032 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1163/2354] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:26 2022] DELETE /identity/v3/users/85974786702245a6b08a57b3d96d8794 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:27.694548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:27.696055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:27.709040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f549b-b738-492c-b3a0-ba0b0656ec8f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:27.721952 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:27.766379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:27.767000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:27.767277 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:27.767545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] PATH_INFO: `/v3/projects/5a33740d49ff43638773eb55e83390f1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:27.768671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a33740d49ff43638773eb55e83390f1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:27.770588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:27.934135 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a33740d49ff43638773eb55e83390f1', 'request_id': 'req-4eb83c83-cf21-4f05-b913-6c83c52ef07d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:27.939647 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a33740d49ff43638773eb55e83390f1', 'request_id': 'req-4eb83c83-cf21-4f05-b913-6c83c52ef07d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:27.945995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a33740d49ff43638773eb55e83390f1', 'request_id': 'req-4eb83c83-cf21-4f05-b913-6c83c52ef07d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:28.081489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] The token cache is being invalidate because project 5a33740d49ff43638773eb55e83390f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:28.081800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:28.082410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4eb83c83-cf21-4f05-b913-6c83c52ef07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:28.083884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1192/2355] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:27 2022] DELETE /identity/v3/projects/5a33740d49ff43638773eb55e83390f1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:28.090138 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db398-eda9-4454-8096-0312acd9aff0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.090645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db398-eda9-4454-8096-0312acd9aff0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.090751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db398-eda9-4454-8096-0312acd9aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.110200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-2c5db398-eda9-4454-8096-0312acd9aff0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:28.111369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2c5db398-eda9-4454-8096-0312acd9aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:28.170863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1164/2356] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:28.179623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262b8c-2174-41ae-a2b3-9dd0b7f1b286 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.179902 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262b8c-2174-41ae-a2b3-9dd0b7f1b286 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.180166 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262b8c-2174-41ae-a2b3-9dd0b7f1b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.200011 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-03262b8c-2174-41ae-a2b3-9dd0b7f1b286 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:28.201164 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-03262b8c-2174-41ae-a2b3-9dd0b7f1b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:28.208832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1193/2357] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:28.213544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5db398-eda9-4454-8096-0312acd9aff0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.223005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5db398-eda9-4454-8096-0312acd9aff0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.227516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.228102 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.228381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.228688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.229331 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:51:28.229630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.231220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.242687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1165/2358] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:51:28.246874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262b8c-2174-41ae-a2b3-9dd0b7f1b286 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.255823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262b8c-2174-41ae-a2b3-9dd0b7f1b286 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.260876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.261451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.261722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.261988 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.262612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.264502 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.350993 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1194/2359] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:28 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:28.355231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.365270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e950684-20aa-49d2-bceb-e53a7a150647 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.422653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.423243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.423521 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.423790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.424410 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.426354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.515434 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1166/2360] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:28 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:28.519440 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.529563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ca434-2d83-4ccf-9bf9-09cec4529e3b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.534142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.534732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.535006 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.535275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.535907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.537803 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.547601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1195/2361] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:28.562089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.572906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed1dc5-6082-487e-98a2-71373018c566 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.577363 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236b8f2-c54f-4eaa-a131-41bbace46cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.577989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236b8f2-c54f-4eaa-a131-41bbace46cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.578263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236b8f2-c54f-4eaa-a131-41bbace46cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.578528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236b8f2-c54f-4eaa-a131-41bbace46cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.579189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236b8f2-c54f-4eaa-a131-41bbace46cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.580800 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236b8f2-c54f-4eaa-a131-41bbace46cc7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.591122 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1167/2362] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:28.595041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.604937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fd826-9ea2-40a0-94fc-7be4dc905448 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.609532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.610163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.610436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.610705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] PATH_INFO: `/v3/projects/be2ebb28039b48759c5e29ae674338d7/users/2f73a0463b5f4e198ae4476d69c0728d/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.625598 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2ebb28039b48759c5e29ae674338d7, user_id=2f73a0463b5f4e198ae4476d69c0728d, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.628233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.704484 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1196/2363] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:28 2022] PUT /identity/v3/projects/be2ebb28039b48759c5e29ae674338d7/users/2f73a0463b5f4e198ae4476d69c0728d/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:28.714754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08b7ec-dbc7-4e89-9956-fcc056ecfa61 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.715037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08b7ec-dbc7-4e89-9956-fcc056ecfa61 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.715306 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08b7ec-dbc7-4e89-9956-fcc056ecfa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.743076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-6a08b7ec-dbc7-4e89-9956-fcc056ecfa61 None None] MFA Rules not processed for user `2f73a0463b5f4e198ae4476d69c0728d`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:28.744300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6a08b7ec-dbc7-4e89-9956-fcc056ecfa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:28.784582 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:28.807344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1168/2364] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:28.818122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:28.819847 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:28.864807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:28.876754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d289e6-16dd-4be7-8cdb-ee0d74c2952a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:28.880353 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9f779-af15-41a7-a7b2-3c5df2cb4828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:28.881021 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9f779-af15-41a7-a7b2-3c5df2cb4828 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:28.881297 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9f779-af15-41a7-a7b2-3c5df2cb4828 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:28.881563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9f779-af15-41a7-a7b2-3c5df2cb4828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:28.889626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9f779-af15-41a7-a7b2-3c5df2cb4828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:28.891032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9f779-af15-41a7-a7b2-3c5df2cb4828 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:28.899612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1197/2365] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:34.329066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08b7ec-dbc7-4e89-9956-fcc056ecfa61 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:34.389638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08b7ec-dbc7-4e89-9956-fcc056ecfa61 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:34.394090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:34.394709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:34.394997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:34.395263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] PATH_INFO: `/v3/users/2f73a0463b5f4e198ae4476d69c0728d` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:34.396395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f73a0463b5f4e198ae4476d69c0728d)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:34.398356 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:34.593154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f73a0463b5f4e198ae4476d69c0728d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:34.593828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f73a0463b5f4e198ae4476d69c0728d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:34.606077 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f73a0463b5f4e198ae4476d69c0728d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:34.613254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f73a0463b5f4e198ae4476d69c0728d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:34.704041 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f73a0463b5f4e198ae4476d69c0728d'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:34.710082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1169/2366] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:34 2022] DELETE /identity/v3/users/2f73a0463b5f4e198ae4476d69c0728d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:34.715284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:34.715761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:34.715860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:34.734366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:34.735559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:34.792792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1198/2367] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:34.802284 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:34.803655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:34.859883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951abae3-1a8b-413e-a795-fdcb84d5bb94 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:34.863431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbce7c-3cb4-4909-90ee-cbd49622762b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:34.864022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbce7c-3cb4-4909-90ee-cbd49622762b service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:34.864299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbce7c-3cb4-4909-90ee-cbd49622762b service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:34.864599 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbce7c-3cb4-4909-90ee-cbd49622762b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:34.873755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbce7c-3cb4-4909-90ee-cbd49622762b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:34.875172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbce7c-3cb4-4909-90ee-cbd49622762b service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:34.884996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1170/2368] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:35.306068 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:35.307477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:35.319560 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77d702-a9b5-4394-8fca-944fac98630e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:35.324147 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:35.324794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:35.325064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:35.325330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] PATH_INFO: `/v3/projects/be2ebb28039b48759c5e29ae674338d7` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:35.326542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2ebb28039b48759c5e29ae674338d7)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:35.328692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:35.447510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2ebb28039b48759c5e29ae674338d7', 'request_id': 'req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:35.453341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2ebb28039b48759c5e29ae674338d7', 'request_id': 'req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:35.459520 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2ebb28039b48759c5e29ae674338d7', 'request_id': 'req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:35.544288 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] The token cache is being invalidate because project be2ebb28039b48759c5e29ae674338d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:35.544625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:35.545241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-dba65c22-25c1-4dcb-ad5b-9c79f91301a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:35.546722 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1199/2369] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:35 2022] DELETE /identity/v3/projects/be2ebb28039b48759c5e29ae674338d7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:35.552460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047965b6-11b0-42a2-9b86-f19eba72b1b2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:35.552460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047965b6-11b0-42a2-9b86-f19eba72b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:35.552460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047965b6-11b0-42a2-9b86-f19eba72b1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:35.560649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:35.571524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-047965b6-11b0-42a2-9b86-f19eba72b1b2 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:35.572797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-047965b6-11b0-42a2-9b86-f19eba72b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:35.630358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1171/2370] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:35.638874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2b27-7aee-419b-9559-55e7e8331b86 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:35.639151 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2b27-7aee-419b-9559-55e7e8331b86 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:35.639423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2b27-7aee-419b-9559-55e7e8331b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:35.659407 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d30e2b27-7aee-419b-9559-55e7e8331b86 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:35.660610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d30e2b27-7aee-419b-9559-55e7e8331b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:35.669076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1200/2371] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:35.673101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047965b6-11b0-42a2-9b86-f19eba72b1b2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:35.682666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047965b6-11b0-42a2-9b86-f19eba72b1b2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:35.687126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:35.687738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:35.688012 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:35.688277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:35.688950 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:51:35.689246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:35.690827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:35.702344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1172/2372] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:51:35.706578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2b27-7aee-419b-9559-55e7e8331b86 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:35.716235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2b27-7aee-419b-9559-55e7e8331b86 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:35.720920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:35.721498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:35.721777 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:35.722047 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:35.722664 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:35.724577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:35.808360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1201/2373] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:35 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:35.812456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:35.822239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc4b87-4422-494b-88df-b6f256cb8702 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:35.880942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:35.881539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:35.881816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:35.882086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:35.882700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:35.885209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:35.984652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1173/2374] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:35 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:35.988689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:35.998994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb3b41-4400-4b57-b7ba-b651200f5c1a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.003625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.004246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.004563 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.004836 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.005493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.007090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.017392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1202/2375] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:36.021154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:36.031891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029aedf2-2fd7-4fd4-907d-75f104149e99 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.036699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0939f-798d-459d-b4ab-3e2403ad747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.037540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0939f-798d-459d-b4ab-3e2403ad747b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.037812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0939f-798d-459d-b4ab-3e2403ad747b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.038076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0939f-798d-459d-b4ab-3e2403ad747b admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.038702 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0939f-798d-459d-b4ab-3e2403ad747b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.040417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0939f-798d-459d-b4ab-3e2403ad747b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.050796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1174/2376] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:36.054947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:36.065036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4e2e8-2e2e-4335-ad1f-dcb8a204c5f5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.069645 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.070222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.070500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.070774 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] PATH_INFO: `/v3/projects/d093f1779d4449479577ffcd681adfde/users/c55491b2ff6640a7851e0adc1760e176/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.085854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d093f1779d4449479577ffcd681adfde, user_id=c55491b2ff6640a7851e0adc1760e176, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.088535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.190656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1203/2377] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:36 2022] PUT /identity/v3/projects/d093f1779d4449479577ffcd681adfde/users/c55491b2ff6640a7851e0adc1760e176/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:51:36.201007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c476a-f6ea-467a-996b-6b724cd6c950 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.201290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c476a-f6ea-467a-996b-6b724cd6c950 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.201560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c476a-f6ea-467a-996b-6b724cd6c950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.229081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-c64c476a-f6ea-467a-996b-6b724cd6c950 None None] MFA Rules not processed for user `c55491b2ff6640a7851e0adc1760e176`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:36.230840 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c64c476a-f6ea-467a-996b-6b724cd6c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:36.289421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:36.293708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1175/2378] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:36.298263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:36.307062 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:36.358967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05e1dc-3a61-40e1-b84b-59d41847baed admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.363601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.364190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.364491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.364761 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.365394 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.367373 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.484234 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1204/2379] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:36 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:36.487978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c476a-f6ea-467a-996b-6b724cd6c950 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:36.498646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c476a-f6ea-467a-996b-6b724cd6c950 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.553824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.554460 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.554721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.554989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.555626 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.557605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.642359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1176/2380] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:36 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:51:36.646356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:36.658272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32820c2f-2701-423d-a409-da5cfea0b26c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.663354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.663989 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.664271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.664580 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.665226 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.666823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.678710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1205/2381] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:36.682862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:36.692910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac936d4-5d65-48cc-a319-33218beae62a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.697566 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60002a22-0b23-4b31-ac81-7066abf83998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.698148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002a22-0b23-4b31-ac81-7066abf83998 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.698425 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002a22-0b23-4b31-ac81-7066abf83998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.698695 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002a22-0b23-4b31-ac81-7066abf83998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.699836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60002a22-0b23-4b31-ac81-7066abf83998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.701481 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60002a22-0b23-4b31-ac81-7066abf83998 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.711222 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1177/2382] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:36.715832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:36.725644 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e446ce9-f21b-4a43-99c3-2a307c5db040 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:36.730300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:36.730938 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.731222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.731492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] PATH_INFO: `/v3/projects/490d1262d18941de84badd417c34b185/users/1b49dd49800a44ca8a3850cc72eb20eb/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.745863 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=490d1262d18941de84badd417c34b185, user_id=1b49dd49800a44ca8a3850cc72eb20eb, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:36.748551 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:36.858300 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1206/2383] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:36 2022] PUT /identity/v3/projects/490d1262d18941de84badd417c34b185/users/1b49dd49800a44ca8a3850cc72eb20eb/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:51:36.868549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c85257-69cb-4525-9a38-0db305a2ddbd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:36.868835 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c85257-69cb-4525-9a38-0db305a2ddbd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:36.869116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c85257-69cb-4525-9a38-0db305a2ddbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:36.897739 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-53c85257-69cb-4525-9a38-0db305a2ddbd None None] MFA Rules not processed for user `1b49dd49800a44ca8a3850cc72eb20eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:36.898849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-53c85257-69cb-4525-9a38-0db305a2ddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:36.961850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1178/2384] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:36.966610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.027690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7eeff-10ac-4648-adc7-72e9fce0e471 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.032378 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.033000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.033278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.033550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.034184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:37.036084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:37.119051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1207/2385] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:36 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:51:37.126548 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c85257-69cb-4525-9a38-0db305a2ddbd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.139895 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c85257-69cb-4525-9a38-0db305a2ddbd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.194963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.195491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.195770 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.196040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.196709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:37.198617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:37.282105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:37.288214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1179/2386] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:37 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:37.292111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.303108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b0ab2-4096-460d-92dc-b3706292bac1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.307885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.308492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.308768 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.309034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.310302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:37.311884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:37.322946 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1208/2387] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:37.328700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.338631 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c1b81-307d-4ef5-88e5-70df939f7d15 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.343300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.343940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.344220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.344552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] PATH_INFO: `/v3/projects/8bfc3781f32a4cb38db14e31dd814814/users/19c083cb211446afbc900be1ad396939/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.360479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfc3781f32a4cb38db14e31dd814814, user_id=19c083cb211446afbc900be1ad396939, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:37.363145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:37.464559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1180/2388] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:37 2022] PUT /identity/v3/projects/8bfc3781f32a4cb38db14e31dd814814/users/19c083cb211446afbc900be1ad396939/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:37.468587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.478500 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66f545-b413-4044-ada1-7c9247ab672c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.506043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:37.535828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61a536-aa67-491e-864b-b5fb6ec760dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.536425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a536-aa67-491e-864b-b5fb6ec760dc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.537827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a536-aa67-491e-864b-b5fb6ec760dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.537827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61a536-aa67-491e-864b-b5fb6ec760dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.538037 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61a536-aa67-491e-864b-b5fb6ec760dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:37.539521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61a536-aa67-491e-864b-b5fb6ec760dc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:37.549630 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1209/2389] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:37.553874 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.565036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8047d0-7a32-49bd-81c3-d2318882aac4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.569608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.570235 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.570513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.570781 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] PATH_INFO: `/v3/projects/8bfc3781f32a4cb38db14e31dd814814/users/19c083cb211446afbc900be1ad396939/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.572709 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfc3781f32a4cb38db14e31dd814814, user_id=19c083cb211446afbc900be1ad396939, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:37.575344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:37.585384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1181/2390] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:37 2022] PUT /identity/v3/projects/8bfc3781f32a4cb38db14e31dd814814/users/19c083cb211446afbc900be1ad396939/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:37.596354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.600752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.600752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.626140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] MFA Rules not processed for user `19c083cb211446afbc900be1ad396939`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:37.627382 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:37.695985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1210/2391] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:37.707241 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:37.708989 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:37.766134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76e10a-dc70-4602-a589-dcceb6b0ef0d admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:37.768908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:37.769485 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:37.769756 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:37.770019 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:37.825038 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:37.826467 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:37.835130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1182/2392] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:40.010770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:40.012276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:40.024869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb69b9-81be-44e4-a240-6a56e01d48cb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:40.028350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:40.029040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:40.029317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:40.029589 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:40.084822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:40.086240 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:40.094969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1211/2393] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:41.538059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:41.546696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a017ca-e683-4d9c-9e1a-e8df2ddcf5fe service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:41.550270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64b264-fad4-4cc6-8279-e56c2a95492a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:41.550852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b264-fad4-4cc6-8279-e56c2a95492a service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:41.551129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b264-fad4-4cc6-8279-e56c2a95492a service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:41.551398 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64b264-fad4-4cc6-8279-e56c2a95492a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:41.560051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64b264-fad4-4cc6-8279-e56c2a95492a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:41.561491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64b264-fad4-4cc6-8279-e56c2a95492a service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:41.571141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1183/2394] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:46.230458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:46.277314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:46.291439 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbf5bf-7a6a-47a6-9c56-08ecbd27830c service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:46.296073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:46.296754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:46.301077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:46.301077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] PATH_INFO: `/v3/users/c55491b2ff6640a7851e0adc1760e176` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:46.301077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55491b2ff6640a7851e0adc1760e176)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:46.301077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:46.530085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55491b2ff6640a7851e0adc1760e176'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:46.537124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55491b2ff6640a7851e0adc1760e176'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:46.538169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55491b2ff6640a7851e0adc1760e176'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:46.538765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55491b2ff6640a7851e0adc1760e176'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:46.664250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55491b2ff6640a7851e0adc1760e176'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:46.682361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1212/2395] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:46 2022] DELETE /identity/v3/users/c55491b2ff6640a7851e0adc1760e176 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:46.686864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:46.687337 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:46.687431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:46.706975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:46.708165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:46.767348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1184/2396] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:46.777004 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:46.778405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:46.835280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612e632-c086-4f87-887e-5445c20b0a61 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:46.838844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:46.839436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:46.839711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:46.839979 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:46.848842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:46.850263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:46.859509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1213/2397] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:51:47.295712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:47.297194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:47.304115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:47.310450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20200-628b-4f1c-9642-ee5f43648eab None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:47.315090 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:47.315719 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:47.315996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:47.316269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] PATH_INFO: `/v3/projects/d093f1779d4449479577ffcd681adfde` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:47.317415 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d093f1779d4449479577ffcd681adfde)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:47.320531 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:47.435645 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd093f1779d4449479577ffcd681adfde', 'request_id': 'req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.442147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd093f1779d4449479577ffcd681adfde', 'request_id': 'req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.447833 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd093f1779d4449479577ffcd681adfde', 'request_id': 'req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.531627 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] The token cache is being invalidate because project d093f1779d4449479577ffcd681adfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:47.531909 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.532545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.534048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1185/2398] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:47 2022] DELETE /identity/v3/projects/d093f1779d4449479577ffcd681adfde => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:47.538559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:47.548772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169481-d297-47c1-ad90-3aedbfc2d42e service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:47.604271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:47.604911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:47.605184 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:47.605450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] PATH_INFO: `/v3/users/1b49dd49800a44ca8a3850cc72eb20eb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:47.606544 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b49dd49800a44ca8a3850cc72eb20eb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:47.608456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:47.621495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:47.947877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b49dd49800a44ca8a3850cc72eb20eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.954939 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b49dd49800a44ca8a3850cc72eb20eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.955594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b49dd49800a44ca8a3850cc72eb20eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:47.956189 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b49dd49800a44ca8a3850cc72eb20eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:48.087346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b49dd49800a44ca8a3850cc72eb20eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:48.104601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1214/2399] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:47 2022] DELETE /identity/v3/users/1b49dd49800a44ca8a3850cc72eb20eb => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:48.528500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:48.529942 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:48.543179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0fe7c-a217-485f-8a6f-062ec16f5eb0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:48.603130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:48.603736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:48.604043 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:48.604318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] PATH_INFO: `/v3/projects/490d1262d18941de84badd417c34b185` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:48.605466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=490d1262d18941de84badd417c34b185)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:48.607488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:48.703931 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490d1262d18941de84badd417c34b185', 'request_id': 'req-0c906bb0-21e0-48c2-aeb5-e7cdec885117'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:48.710192 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490d1262d18941de84badd417c34b185', 'request_id': 'req-0c906bb0-21e0-48c2-aeb5-e7cdec885117'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:48.715778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490d1262d18941de84badd417c34b185', 'request_id': 'req-0c906bb0-21e0-48c2-aeb5-e7cdec885117'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:48.795183 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] The token cache is being invalidate because project 490d1262d18941de84badd417c34b185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:48.795407 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:48.796054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:48.797560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1186/2400] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:48 2022] DELETE /identity/v3/projects/490d1262d18941de84badd417c34b185 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:48.801596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:48.803125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:48.816704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1eaef-5472-45e8-af4c-37486d6e9bfe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:48.870995 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:48.871610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:48.871880 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:48.872143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] PATH_INFO: `/v3/users/19c083cb211446afbc900be1ad396939` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:48.873271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c083cb211446afbc900be1ad396939)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:48.875201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:49.106971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c083cb211446afbc900be1ad396939'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.114054 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c083cb211446afbc900be1ad396939'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.114752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c083cb211446afbc900be1ad396939'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.115381 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c083cb211446afbc900be1ad396939'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.178435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9897e07-6537-4708-bad8-8b4ede731178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c083cb211446afbc900be1ad396939'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.196036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1215/2401] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:51:48 2022] DELETE /identity/v3/users/19c083cb211446afbc900be1ad396939 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:49.643581 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:49.645062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:49.659897 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c906bb0-21e0-48c2-aeb5-e7cdec885117 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:49.685923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:49.717499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:49.718128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:49.718409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:49.718676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] PATH_INFO: `/v3/projects/8bfc3781f32a4cb38db14e31dd814814` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:49.719797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfc3781f32a4cb38db14e31dd814814)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:49.721728 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:49.841545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfc3781f32a4cb38db14e31dd814814', 'request_id': 'req-7131c728-0e46-4803-bb3d-d90c8beb0b95'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.847761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfc3781f32a4cb38db14e31dd814814', 'request_id': 'req-7131c728-0e46-4803-bb3d-d90c8beb0b95'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.854191 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfc3781f32a4cb38db14e31dd814814', 'request_id': 'req-7131c728-0e46-4803-bb3d-d90c8beb0b95'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.943884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] The token cache is being invalidate because project 8bfc3781f32a4cb38db14e31dd814814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:51:49.944076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.944734 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-7131c728-0e46-4803-bb3d-d90c8beb0b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:51:49.946291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1187/2402] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:51:49 2022] DELETE /identity/v3/projects/8bfc3781f32a4cb38db14e31dd814814 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:49.952635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924ec9-890e-46f2-945b-ce9a48ef077a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:49.953099 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924ec9-890e-46f2-945b-ce9a48ef077a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:49.953197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924ec9-890e-46f2-945b-ce9a48ef077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:49.972326 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2e924ec9-890e-46f2-945b-ce9a48ef077a None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:49.973569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2e924ec9-890e-46f2-945b-ce9a48ef077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:49.977697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:50.031362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1216/2403] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:50.039629 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b692d-53f7-40b2-aefd-028c2aa71502 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.039913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b692d-53f7-40b2-aefd-028c2aa71502 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.040185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b692d-53f7-40b2-aefd-028c2aa71502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.061981 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-061b692d-53f7-40b2-aefd-028c2aa71502 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:50.063158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-061b692d-53f7-40b2-aefd-028c2aa71502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:50.070929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1188/2404] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:50.075322 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924ec9-890e-46f2-945b-ce9a48ef077a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:50.085368 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924ec9-890e-46f2-945b-ce9a48ef077a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:50.092303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:50.092303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.092303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.092303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.092756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:51:50.092756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:50.093531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:50.104956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1217/2405] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:51:50.109676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b692d-53f7-40b2-aefd-028c2aa71502 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:50.118978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b692d-53f7-40b2-aefd-028c2aa71502 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:50.124333 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:50.124979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.125385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.125662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.126291 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:50.128194 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:50.202473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1189/2406] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:51:50 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:50.206892 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:50.216731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c532af5-d7ac-44db-8b1c-5f2c4755c297 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:50.271333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:50.271920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.272199 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.272494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.273125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:50.275028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:50.384222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1218/2407] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:51:50 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:51:50.388512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:50.398786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52199ba-d722-4946-b2bc-bf776e07d7d7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:50.403912 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:50.404528 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.404810 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.405081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.405733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:50.407312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:50.417201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1190/2408] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:50.421600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:50.431279 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cd25c-55e4-4e4d-b39b-f8d663c12190 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:50.435890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac3c18-402c-4791-adad-3d58adcc3c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:50.436478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac3c18-402c-4791-adad-3d58adcc3c0d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.436758 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac3c18-402c-4791-adad-3d58adcc3c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.437023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac3c18-402c-4791-adad-3d58adcc3c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.437641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac3c18-402c-4791-adad-3d58adcc3c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:50.439207 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac3c18-402c-4791-adad-3d58adcc3c0d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:50.449523 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1219/2409] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:51:50.453373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:50.462954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69b4eb-7f04-4327-9106-7df00e1c1f91 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:50.468062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:50.468743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.469018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.469305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] PATH_INFO: `/v3/projects/97cd8a1d725240c59be4545afc6beac9/users/8fde23c505b14e3d8b5c6239e795c590/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.484097 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cd8a1d725240c59be4545afc6beac9, user_id=8fde23c505b14e3d8b5c6239e795c590, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:50.486843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:50.579714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1191/2410] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:51:50 2022] PUT /identity/v3/projects/97cd8a1d725240c59be4545afc6beac9/users/8fde23c505b14e3d8b5c6239e795c590/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:51:50.646391 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.646677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.646953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.675511 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] MFA Rules not processed for user `8fde23c505b14e3d8b5c6239e795c590`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:51:50.676737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:50.742767 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1220/2411] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:51:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:51:50.753990 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:51:50.755714 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:51:50.801132 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:51:50.812371 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113aa20-63a4-4827-9033-e3961676fd96 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:51:50.815949 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:51:50.816609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:51:50.816891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:51:50.817230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:51:50.826186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:51:50.827602 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:51:50.836826 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1192/2412] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:51:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:00.739745 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:00.984755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:01.762754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:01.764298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:01.822950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba8b80-2f22-4aeb-ae00-eab3daf2af77 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:01.826521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:01.827123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:01.827401 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:01.827671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:01.829590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:01.879384 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:01.880991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:01.892741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f565ba-22eb-4da3-b65a-d92f33088275 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:01.896380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102f90-8415-461a-8fea-1b412ad94f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:01.897269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102f90-8415-461a-8fea-1b412ad94f20 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:01.897402 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102f90-8415-461a-8fea-1b412ad94f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:01.897738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102f90-8415-461a-8fea-1b412ad94f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:01.899632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1b102f90-8415-461a-8fea-1b412ad94f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:01.902081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:01.904012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:01.911522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102f90-8415-461a-8fea-1b412ad94f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:01.911522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102f90-8415-461a-8fea-1b412ad94f20 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:01.917008 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1221/2413] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:01.920858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1193/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:03.124689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:03.133535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fabd7-d02d-4cd5-9751-b9e644f99eb9 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:03.137198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:03.137842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:03.138117 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:03.138437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:03.140124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:03.154479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:03.155968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:03.167084 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1222/2415] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:11.916040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:13.161967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=60 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:17.659798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:17.660282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:17.662945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:17.679379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] MFA Rules not processed for user `9fdcfacce0f04b0a941c016c8e19be28`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:17.680595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:17.735258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1194/2416] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:18.040043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:18.050776 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a79d0c-c808-4e6e-b9e6-db253630a627 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:18.055138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:18.055733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:18.056013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:18.056284 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:18.058079 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:18.068518 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:18.069932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:18.078150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1223/2417] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:18.519960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:18.521397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:18.592064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69025b-eee8-49ac-bc58-1187debe85a1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:18.596946 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:18.597536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:18.597812 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:18.598081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:18.599732 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:18.610617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:18.612168 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:18.622317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1195/2418] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:23.011283 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:23.013361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:23.029843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24782-545b-4c61-af5b-4a9c9ed9bc6b service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:23.035249 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:23.039435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:23.039435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:23.039435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:23.039435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:23.051771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:23.053458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:23.065913 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1224/2419] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:52:28.617690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=57 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:29.639251 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:29.640764 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:29.656196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce7d4c-2911-48c7-8c3b-6da8a948471a service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:29.661666 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbe471-e75d-473c-9a03-3e8ea37ea6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:29.662252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbe471-e75d-473c-9a03-3e8ea37ea6e6 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:29.662550 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbe471-e75d-473c-9a03-3e8ea37ea6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:29.663081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbe471-e75d-473c-9a03-3e8ea37ea6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:29.664777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e4dbe471-e75d-473c-9a03-3e8ea37ea6e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:29.677036 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbe471-e75d-473c-9a03-3e8ea37ea6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:29.678591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbe471-e75d-473c-9a03-3e8ea37ea6e6 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:29.689027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1196/2420] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:30.951039 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:31.012948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326ab2e-bfe4-41ba-98bf-e996ed82a5e0 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:31.017458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:31.018076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:31.018356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:31.018674 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] PATH_INFO: `/v3/users/8fde23c505b14e3d8b5c6239e795c590` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:31.019800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fde23c505b14e3d8b5c6239e795c590)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:31.021756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:31.139980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fde23c505b14e3d8b5c6239e795c590'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.146935 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fde23c505b14e3d8b5c6239e795c590'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.147607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fde23c505b14e3d8b5c6239e795c590'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.148212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fde23c505b14e3d8b5c6239e795c590'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.194566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fde23c505b14e3d8b5c6239e795c590'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.211970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1225/2421] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:52:30 2022] DELETE /identity/v3/users/8fde23c505b14e3d8b5c6239e795c590 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:52:31.216538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:31.217020 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:31.217137 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:31.236115 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:31.237334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:31.295976 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1197/2422] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:31.305765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:31.307200 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:31.366450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796ff40-abed-4fb9-88c5-59d62c0b727f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:31.370055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd18e6-4be1-4cf2-8b28-a30acd969741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:31.370654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd18e6-4be1-4cf2-8b28-a30acd969741 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:31.371656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd18e6-4be1-4cf2-8b28-a30acd969741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:31.371937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd18e6-4be1-4cf2-8b28-a30acd969741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:31.379157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:31.381362 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd18e6-4be1-4cf2-8b28-a30acd969741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:31.382820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd18e6-4be1-4cf2-8b28-a30acd969741 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:31.392713 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1226/2423] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:31.797367 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:31.798786 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:31.811026 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9afe9-1104-498b-a3e8-881754fe50ed None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:31.815676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:31.816300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:31.816613 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:31.816889 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] PATH_INFO: `/v3/projects/97cd8a1d725240c59be4545afc6beac9` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:31.818129 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=97cd8a1d725240c59be4545afc6beac9)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:31.820852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:31.921927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97cd8a1d725240c59be4545afc6beac9', 'request_id': 'req-a3471ae3-548d-4188-a1e2-3222cb24cccc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.928055 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97cd8a1d725240c59be4545afc6beac9', 'request_id': 'req-a3471ae3-548d-4188-a1e2-3222cb24cccc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.933543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97cd8a1d725240c59be4545afc6beac9', 'request_id': 'req-a3471ae3-548d-4188-a1e2-3222cb24cccc'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.977045 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] The token cache is being invalidate because project 97cd8a1d725240c59be4545afc6beac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:52:31.977350 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.977971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-a3471ae3-548d-4188-a1e2-3222cb24cccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:52:31.979435 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1198/2424] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:52:31 2022] DELETE /identity/v3/projects/97cd8a1d725240c59be4545afc6beac9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:52:31.984960 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5d98-5d96-497a-9ca0-4597707e0880 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:31.986596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5d98-5d96-497a-9ca0-4597707e0880 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:31.986596 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5d98-5d96-497a-9ca0-4597707e0880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.005648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cc1a5d98-5d96-497a-9ca0-4597707e0880 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:32.006822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc1a5d98-5d96-497a-9ca0-4597707e0880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:32.071493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1227/2425] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:32.080155 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0350cd-ff5d-4bd3-8d30-c633bfd551fb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.080453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0350cd-ff5d-4bd3-8d30-c633bfd551fb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.080730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0350cd-ff5d-4bd3-8d30-c633bfd551fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.101430 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-1d0350cd-ff5d-4bd3-8d30-c633bfd551fb None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:32.102679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1d0350cd-ff5d-4bd3-8d30-c633bfd551fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:32.111784 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1199/2426] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:32.119697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a5d98-5d96-497a-9ca0-4597707e0880 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.130640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a5d98-5d96-497a-9ca0-4597707e0880 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.135286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.135879 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.136153 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.137003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.137626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:52:32.137919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.139505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.150990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1228/2427] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:52:32.156070 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0350cd-ff5d-4bd3-8d30-c633bfd551fb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.165419 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0350cd-ff5d-4bd3-8d30-c633bfd551fb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.170015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.170596 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.170872 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.171142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.171767 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.173752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.246793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1200/2428] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:52:32 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:52:32.251034 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.260985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0543b-912f-49bc-8e3a-54e61d9c222a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.317061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.317650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.317930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.318196 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.318819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.320756 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.429967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1229/2429] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:52:32 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:52:32.434512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.445080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b13ad-3a21-4772-858e-26b93a18e752 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.450325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.450929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.451200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.451464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.452087 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.453706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.463615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1201/2430] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:52:32.470770 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.477532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9d58-360b-405f-8119-5afa7ebe75d8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.482126 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205a206-8048-4467-a874-5cd52d8635fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.482709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205a206-8048-4467-a874-5cd52d8635fa admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.482986 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205a206-8048-4467-a874-5cd52d8635fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.483271 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205a206-8048-4467-a874-5cd52d8635fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.483915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205a206-8048-4467-a874-5cd52d8635fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.485527 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205a206-8048-4467-a874-5cd52d8635fa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.496521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1230/2431] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:52:32.510364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.521522 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d1668-490f-4ae9-a7ed-a84c2546c9ee admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.526160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.526798 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.527493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.527493 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] PATH_INFO: `/v3/projects/b4281533759345469ca70cb4f152f63e/users/1d57ee0b19c743bfb53a4bff316a4089/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.542944 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4281533759345469ca70cb4f152f63e, user_id=1d57ee0b19c743bfb53a4bff316a4089, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.545618 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.618589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1202/2432] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:52:32 2022] PUT /identity/v3/projects/b4281533759345469ca70cb4f152f63e/users/1d57ee0b19c743bfb53a4bff316a4089/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:52:32.624258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.624592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.624829 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.645765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:32.646950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:32.707214 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1231/2433] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:52:32.717153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:32.718881 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:32.729073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:32.777106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e059f-f649-42ed-b35e-805f3b7c6cd4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:32.780901 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68722d2-2ab8-47e7-a496-006d12cf70b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:32.781505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68722d2-2ab8-47e7-a496-006d12cf70b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:32.782051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68722d2-2ab8-47e7-a496-006d12cf70b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:32.782420 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68722d2-2ab8-47e7-a496-006d12cf70b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:32.793257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68722d2-2ab8-47e7-a496-006d12cf70b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:32.794683 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68722d2-2ab8-47e7-a496-006d12cf70b1 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:32.804089 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1203/2434] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:34.161948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:34.163665 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:34.168885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:34.253057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b66680-8438-4b22-af33-a411aa66c417 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:34.258886 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:34.259652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:34.259927 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:34.260717 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:34.263093 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:34.276291 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:34.278537 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:34.289866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1232/2435] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:38.708690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1f8c4-7dc4-44ac-bb55-a0d309714327 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:38.709546 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1f8c4-7dc4-44ac-bb55-a0d309714327 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:38.709979 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1f8c4-7dc4-44ac-bb55-a0d309714327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:38.750364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-23a1f8c4-7dc4-44ac-bb55-a0d309714327 None None] MFA Rules not processed for user `1d57ee0b19c743bfb53a4bff316a4089`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:38.751664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-23a1f8c4-7dc4-44ac-bb55-a0d309714327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:38.830207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1204/2436] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:38.834703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:38.846276 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b0da9-de7f-4670-9a3d-901cec132768 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:38.851258 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:38.853230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:38.853633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:38.853977 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:38.854704 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:38.856794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:38.968854 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1233/2437] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:52:38 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:52:38.972852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1f8c4-7dc4-44ac-bb55-a0d309714327 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:38.983846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1f8c4-7dc4-44ac-bb55-a0d309714327 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:39.046479 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:39.047092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:39.047381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:39.047630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:39.048256 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:39.050285 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:39.161249 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1205/2438] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:52:38 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:52:39.165495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:39.176023 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3546-a3ef-4744-bc0c-9f41221335c5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:39.180990 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:39.181675 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:39.182024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:39.182367 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:39.183654 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:39.185437 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:39.196985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1234/2439] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:52:39.201270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:39.216223 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679f9aa-dddb-4162-b937-b4a728d1371e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:39.221255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:39.221924 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:39.222202 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:39.222472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] PATH_INFO: `/v3/projects/7e33c06390294c2c81821619c6dd9d24/users/86ef566b196c4502b4b273ef3d756afa/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:39.240272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e33c06390294c2c81821619c6dd9d24, user_id=86ef566b196c4502b4b273ef3d756afa, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:39.243134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:39.340053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1206/2440] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:52:39 2022] PUT /identity/v3/projects/7e33c06390294c2c81821619c6dd9d24/users/86ef566b196c4502b4b273ef3d756afa/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:52:39.343970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:39.354331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837dc49-b995-45d7-aca0-4c9ca28c1961 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:39.414877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1028052-dbf3-4307-8f45-235a38d92f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:39.415516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1028052-dbf3-4307-8f45-235a38d92f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:39.415793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1028052-dbf3-4307-8f45-235a38d92f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:39.416060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1028052-dbf3-4307-8f45-235a38d92f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:39.416764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1028052-dbf3-4307-8f45-235a38d92f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:39.418959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1028052-dbf3-4307-8f45-235a38d92f22 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:39.429396 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1235/2441] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:52:39.433616 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:39.440975 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:39.444863 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba2986-67b0-444e-b1b3-533b2d885d90 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:39.449769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:39.450436 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:39.450866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:39.450977 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] PATH_INFO: `/v3/projects/7e33c06390294c2c81821619c6dd9d24/users/86ef566b196c4502b4b273ef3d756afa/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:39.452939 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e33c06390294c2c81821619c6dd9d24, user_id=86ef566b196c4502b4b273ef3d756afa, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:39.455630 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:39.470466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1207/2442] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:52:39 2022] PUT /identity/v3/projects/7e33c06390294c2c81821619c6dd9d24/users/86ef566b196c4502b4b273ef3d756afa/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:52:45.002971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e401f-0431-40f3-b800-63cd8c5153ba None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:45.003750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e401f-0431-40f3-b800-63cd8c5153ba None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:45.004080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e401f-0431-40f3-b800-63cd8c5153ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:45.036895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-212e401f-0431-40f3-b800-63cd8c5153ba None None] MFA Rules not processed for user `86ef566b196c4502b4b273ef3d756afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:45.038387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-212e401f-0431-40f3-b800-63cd8c5153ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:45.086145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:45.128601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1236/2443] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:45.138230 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:52:45.139996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:45.219639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45039193-367b-4929-9885-2e3000e232f4 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:52:45.225433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:52:45.226044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:45.226322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:45.226589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:45.285721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:52:45.287341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:52:45.298163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1208/2444] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:52:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:52:49.076490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd6e6c-0432-4c18-a3ac-933ba4656dc0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:52:49.079741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd6e6c-0432-4c18-a3ac-933ba4656dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:52:49.079741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd6e6c-0432-4c18-a3ac-933ba4656dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:52:49.096138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e5bd6e6c-0432-4c18-a3ac-933ba4656dc0 None None] MFA Rules not processed for user `1d57ee0b19c743bfb53a4bff316a4089`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:52:49.097388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e5bd6e6c-0432-4c18-a3ac-933ba4656dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:52:49.105250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1237/2445] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:52:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:52:55.293607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:52:59.090428 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=14 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:10.318559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:10.372995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895664a-faa1-4c8b-91cc-a0d21804faaf service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:10.376678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafe96b-e289-44ad-9b1b-02ba3f441d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:10.377209 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe96b-e289-44ad-9b1b-02ba3f441d24 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:10.377494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe96b-e289-44ad-9b1b-02ba3f441d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:10.377765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafe96b-e289-44ad-9b1b-02ba3f441d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:10.379553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-feafe96b-e289-44ad-9b1b-02ba3f441d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:10.389669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe96b-e289-44ad-9b1b-02ba3f441d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:10.391084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafe96b-e289-44ad-9b1b-02ba3f441d24 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:10.400046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1209/2446] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:20.395503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=26 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:27.779812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd6e6c-0432-4c18-a3ac-933ba4656dc0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:27.790869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd6e6c-0432-4c18-a3ac-933ba4656dc0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:27.794489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:27.797550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:27.797550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:27.797550 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:27.805469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:27.806962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:27.817569 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1238/2447] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:53:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:53:35.131204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:35.133072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:35.133072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:35.179908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] MFA Rules not processed for user `fdcfc478d70e4bc388cfd0dff157a817`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:53:35.181636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:35.243248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1210/2448] 10.222.0.39 () {58 vars in 967 bytes} [Wed Nov 2 07:53:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:53:35.282422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:35.283786 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:35.372169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280773-710e-420d-a48f-ee8067176f00 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:35.377169 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7037b6179bdd434db3780d97d20060bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:35.377760 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:35.378035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:35.378303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:35.386932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:35.388539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:35.396436 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1239/2449] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Nov 2 07:53:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 07:53:43.441896 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:43.443465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:43.508908 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbac747-88af-4ce7-9c25-b015e29547cd None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:43.513382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:43.513996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:43.514271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:43.514540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] PATH_INFO: `/v3/users/6d9ca005594b416e8009b25250144503` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:43.515652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9ca005594b416e8009b25250144503)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:43.517595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:43.727706 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9ca005594b416e8009b25250144503'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:43.728275 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9ca005594b416e8009b25250144503'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:43.740243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9ca005594b416e8009b25250144503'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:43.747733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9ca005594b416e8009b25250144503'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:43.749405 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:43.833595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9ca005594b416e8009b25250144503'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:43.840180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1211/2450] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:43 2022] DELETE /identity/v3/users/6d9ca005594b416e8009b25250144503 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:44.080941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:44.092013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a4c0d-0d89-428e-a5b7-fa09efbf0fd9 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:44.152455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:44.153230 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:44.153507 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:44.153779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] PATH_INFO: `/v3/projects/3d5592e8f779405499305dd22a99768a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:44.154920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5592e8f779405499305dd22a99768a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:44.156866 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:44.245933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5592e8f779405499305dd22a99768a', 'request_id': 'req-4a838eb0-439c-499d-ba39-52d4d4c6cf96'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.251350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5592e8f779405499305dd22a99768a', 'request_id': 'req-4a838eb0-439c-499d-ba39-52d4d4c6cf96'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.252404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:44.258659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5592e8f779405499305dd22a99768a', 'request_id': 'req-4a838eb0-439c-499d-ba39-52d4d4c6cf96'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.353481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] The token cache is being invalidate because project 3d5592e8f779405499305dd22a99768a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:44.353765 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.354364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.355830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1240/2451] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:44 2022] DELETE /identity/v3/projects/3d5592e8f779405499305dd22a99768a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:44.359852 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:44.361247 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:44.374565 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0793e13-d2de-471a-b1ba-826f1e3a9b7e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:44.431147 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:44.431777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:44.432049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:44.432311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] PATH_INFO: `/v3/users/aaf530720c744d5894d50a50424dd1cd` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:44.433453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf530720c744d5894d50a50424dd1cd)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:44.435355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:44.630667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf530720c744d5894d50a50424dd1cd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.631310 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf530720c744d5894d50a50424dd1cd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.642916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf530720c744d5894d50a50424dd1cd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.650175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf530720c744d5894d50a50424dd1cd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.731614 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-19a2f7a0-6f4d-4f20-87cc-a5000f154603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf530720c744d5894d50a50424dd1cd'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:44.738198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1212/2452] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:53:44 2022] DELETE /identity/v3/users/aaf530720c744d5894d50a50424dd1cd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:44.967249 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:53:44.968694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:53:44.984656 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a838eb0-439c-499d-ba39-52d4d4c6cf96 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:53:45.043055 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:53:45.043684 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:53:45.044007 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:53:45.044280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] PATH_INFO: `/v3/projects/9b840fb7d28b4ead90c3affe1ec00d77` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:53:45.045418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b840fb7d28b4ead90c3affe1ec00d77)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:53:45.047332 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:53:45.177257 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b840fb7d28b4ead90c3affe1ec00d77', 'request_id': 'req-19fd5228-08a7-4e15-ab0f-bfa91050519b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:45.183508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b840fb7d28b4ead90c3affe1ec00d77', 'request_id': 'req-19fd5228-08a7-4e15-ab0f-bfa91050519b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:45.189841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b840fb7d28b4ead90c3affe1ec00d77', 'request_id': 'req-19fd5228-08a7-4e15-ab0f-bfa91050519b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:45.255985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] The token cache is being invalidate because project 9b840fb7d28b4ead90c3affe1ec00d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:53:45.256223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:45.256839 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:53:45.258342 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1241/2453] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:53:44 2022] DELETE /identity/v3/projects/9b840fb7d28b4ead90c3affe1ec00d77 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:53:54.734508 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=55 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:53:55.252832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=55,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:54:19.093382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:54:19.098941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:54:19.098941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:54:19.112809 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] MFA Rules not processed for user `9fdcfacce0f04b0a941c016c8e19be28`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:54:19.114109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:54:19.169079 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1213/2454] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:54:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:54:29.162165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=25 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:55:16.165968 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:55:16.167477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:16.235623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd5228-08a7-4e15-ab0f-bfa91050519b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:55:16.241274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77372c18-01ea-4443-9f6b-0163d990dbb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:55:16.241901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372c18-01ea-4443-9f6b-0163d990dbb9 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:16.242178 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372c18-01ea-4443-9f6b-0163d990dbb9 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:16.242452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77372c18-01ea-4443-9f6b-0163d990dbb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:16.244159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-77372c18-01ea-4443-9f6b-0163d990dbb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:16.255455 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77372c18-01ea-4443-9f6b-0163d990dbb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:55:16.258197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77372c18-01ea-4443-9f6b-0163d990dbb9 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:55:16.266955 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1242/2455] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:55:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:55:26.269314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=32 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:55:49.013588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:55:49.015250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:49.087510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6dc88-1c7c-4df3-9cff-196cea6068e2 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:55:49.092920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:55:49.093516 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:55:49.093794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:55:49.094064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:55:49.095745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:55:49.106314 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:55:49.107879 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:55:49.117231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1214/2456] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:55:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:55:59.112576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=34 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:56:04.706457 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390d33-a96a-408d-a06d-f5cdc2a952c4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:56:04.706925 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390d33-a96a-408d-a06d-f5cdc2a952c4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:56:04.707082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390d33-a96a-408d-a06d-f5cdc2a952c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:56:04.726624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7d390d33-a96a-408d-a06d-f5cdc2a952c4 None None] MFA Rules not processed for user `9fdcfacce0f04b0a941c016c8e19be28`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:56:04.727810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7d390d33-a96a-408d-a06d-f5cdc2a952c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:56:04.734631 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1243/2457] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:56:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:56:11.440180 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:56:11.441735 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:56:11.505689 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f601a-2d3e-44f9-954c-d914318fd931 service nova] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:56:11.509221 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:56:11.509816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:56:11.510092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:56:11.510357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:56:11.512044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:56:11.521112 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:56:11.522520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:56:11.530182 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1215/2458] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:56:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:56:11.610418 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390d33-a96a-408d-a06d-f5cdc2a952c4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:56:11.620022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d390d33-a96a-408d-a06d-f5cdc2a952c4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:56:11.624159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:56:11.624802 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:56:11.625076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:56:11.625343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:56:11.627038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:56:11.640232 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:56:11.641703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:56:11.652841 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1244/2459] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:56:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:56:21.527270 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=26 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:56:21.647659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=9 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:15.873884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:15.875282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:15.886104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157acf4d-f3e4-494c-ac2e-1273896b9f78 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:15.891253 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:15.891843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:15.892114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:15.892379 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:15.894076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:15.904139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:15.905579 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:15.913382 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1216/2460] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:25.909803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:39.493438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:39.494859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:39.579587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1081b1-7b89-46a3-b376-9a6636e04c84 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:39.583124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:39.583739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:39.584009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:39.584274 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:39.585985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:39.620634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:39.622042 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:39.633323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1245/2461] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:42.847991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:42.849456 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:42.890520 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a987b4-db3e-4749-937a-b04471f43eed service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:42.894187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:42.898374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:42.898374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:42.898374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:42.898374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:42.910514 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:42.911920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:42.924082 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1217/2462] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:48.695613 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:48.697046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:48.710689 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125f02a-b583-4afa-979e-33fb0b9ab7bb service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:48.716143 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5e6e7eee9ea4be093bb283594f7651c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:48.716769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:48.717046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:48.717314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:48.719528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:48.731970 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:48.734295 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:48.746193 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1246/2463] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:52.918255 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=19 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:55.308368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:55.326554 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5513c69-a395-4ed6-9150-bb02023b7981 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:55.330116 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:55.330690 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:55.330963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:55.331229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:55.332938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:55.415106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:55.416458 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:55.434254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1218/2464] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:58.720229 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:58.721784 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:58.736077 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fdde-cd59-45cd-8d69-75eeca5f3ebb service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:58.740931 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:58.741648 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:58.741928 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:58.742194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:58.744072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:58.756080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:58.757909 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:58.767568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1247/2465] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:57:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:57:58.813529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:58.815072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:58.832854 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ffabe-c851-4ed4-8697-f36808aee812 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:58.833423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:58.833638 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:58.833909 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:58.834185 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] PATH_INFO: `/v3/users/9fdcfacce0f04b0a941c016c8e19be28` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:58.835300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdcfacce0f04b0a941c016c8e19be28)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:58.837259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:59.015911 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdcfacce0f04b0a941c016c8e19be28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.016610 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdcfacce0f04b0a941c016c8e19be28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.028705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdcfacce0f04b0a941c016c8e19be28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.036186 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdcfacce0f04b0a941c016c8e19be28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.132542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-df4493b1-034e-41e8-b71b-6fec90225ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdcfacce0f04b0a941c016c8e19be28'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.138948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1219/2466] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:57:58 2022] DELETE /identity/v3/users/9fdcfacce0f04b0a941c016c8e19be28 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:57:59.407264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:59.419066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980e4fc-66d4-4948-b8b5-20d0d78d1ca7 service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:59.474915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:59.475538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:59.475812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:59.476081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] PATH_INFO: `/v3/projects/af69474d892c4179af2f6bb5217e1cb1` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:59.477215 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=af69474d892c4179af2f6bb5217e1cb1)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:59.479156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:59.570083 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:59.582822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af69474d892c4179af2f6bb5217e1cb1', 'request_id': 'req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.588109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af69474d892c4179af2f6bb5217e1cb1', 'request_id': 'req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.594194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af69474d892c4179af2f6bb5217e1cb1', 'request_id': 'req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.674376 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] The token cache is being invalidate because project af69474d892c4179af2f6bb5217e1cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:57:59.674505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.675108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ec6e69cc-59d1-45bc-8ed1-41cb79d25aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:57:59.676584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1248/2467] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:57:59 2022] DELETE /identity/v3/projects/af69474d892c4179af2f6bb5217e1cb1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:57:59.681556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d86f8-0152-4ca0-9565-33f7e3714326 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:59.681846 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d86f8-0152-4ca0-9565-33f7e3714326 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:59.682120 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d86f8-0152-4ca0-9565-33f7e3714326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:59.720644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:57:59.738477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-954d86f8-0152-4ca0-9565-33f7e3714326 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:57:59.739698 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-954d86f8-0152-4ca0-9565-33f7e3714326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:59.796081 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1220/2468] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:57:59.803855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f36e1-2b3a-4f4d-9b7a-a4890c17778f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:59.804348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f36e1-2b3a-4f4d-9b7a-a4890c17778f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:59.804496 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f36e1-2b3a-4f4d-9b7a-a4890c17778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:59.824465 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7d0f36e1-2b3a-4f4d-9b7a-a4890c17778f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:57:59.825594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7d0f36e1-2b3a-4f4d-9b7a-a4890c17778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:57:59.834655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1249/2469] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:57:59.838980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d86f8-0152-4ca0-9565-33f7e3714326 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:59.848876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d86f8-0152-4ca0-9565-33f7e3714326 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:59.853484 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:59.854066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:59.854341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:59.854608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:59.855246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:57:59.855543 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:59.857302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:59.869047 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1221/2470] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:57:59.873265 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f36e1-2b3a-4f4d-9b7a-a4890c17778f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:57:59.883162 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f36e1-2b3a-4f4d-9b7a-a4890c17778f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:57:59.887778 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:57:59.888356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:57:59.888661 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:57:59.888929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:57:59.889548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:57:59.892139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:57:59.985771 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1250/2471] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:57:59 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:57:59.989983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.000953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3445d-efcf-4f8d-b6c0-4c64b44af7c2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.055827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.056465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.056745 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.057010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.057662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.059547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.136871 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1222/2472] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:57:59 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:00.141108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.151584 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43588080-04a8-4889-b161-bef5e6b15f57 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.156201 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.156905 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.157243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.157522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.158157 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.159750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.170003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1251/2473] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:00.174623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.184636 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92833be-1379-400e-89c1-2ad788afdfe5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.189868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b37f8-596f-4e29-be56-43925dc5ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.190440 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b37f8-596f-4e29-be56-43925dc5ce93 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.190713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b37f8-596f-4e29-be56-43925dc5ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.190980 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b37f8-596f-4e29-be56-43925dc5ce93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.191604 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b37f8-596f-4e29-be56-43925dc5ce93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.193243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b37f8-596f-4e29-be56-43925dc5ce93 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.203503 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1223/2474] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:00.207702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.217680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fd7c9-d5ea-4cdb-9e53-482df18651e3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.222272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.222912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.223217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.223494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] PATH_INFO: `/v3/projects/fedea7237b724f4380fbbe23158a3834/users/b535d9c90fbd49338d94015b6c024a73/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.238546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedea7237b724f4380fbbe23158a3834, user_id=b535d9c90fbd49338d94015b6c024a73, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.241267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.314812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1252/2475] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:00 2022] PUT /identity/v3/projects/fedea7237b724f4380fbbe23158a3834/users/b535d9c90fbd49338d94015b6c024a73/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:58:00.325229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffee10-8048-49cf-af71-06662ea5c2b3 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.325540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffee10-8048-49cf-af71-06662ea5c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.325811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffee10-8048-49cf-af71-06662ea5c2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.353480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-d8ffee10-8048-49cf-af71-06662ea5c2b3 None None] MFA Rules not processed for user `b535d9c90fbd49338d94015b6c024a73`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:00.354655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d8ffee10-8048-49cf-af71-06662ea5c2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:00.408215 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:00.418150 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1224/2476] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:00.423212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.483475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be085-30eb-467e-bcfe-cee4fbd8aae1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.488750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.489348 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.489626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.489895 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.490528 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.492423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.578998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1253/2477] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:00 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:00.583063 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffee10-8048-49cf-af71-06662ea5c2b3 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.594789 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffee10-8048-49cf-af71-06662ea5c2b3 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.651563 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.652156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.652451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.652731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.653345 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.655243 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.726569 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1225/2478] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:00 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:00.730429 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.740929 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d970a-a7a3-4e86-b206-f4c038b2f85a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.745667 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.746314 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.746582 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.746852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.747487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.749110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.759651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1254/2479] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:00.763585 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.773849 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4fd89-2412-461c-8c27-70f76d1273da admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.778504 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.779133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.779414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.779682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] PATH_INFO: `/v3/projects/7299a7ea80f44e8fac2884aaa3eebfa9/users/2a964e488a3743b4bf5ac329773b8a3e/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.795037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7299a7ea80f44e8fac2884aaa3eebfa9, user_id=2a964e488a3743b4bf5ac329773b8a3e, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.797707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.875958 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1226/2480] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:00 2022] PUT /identity/v3/projects/7299a7ea80f44e8fac2884aaa3eebfa9/users/2a964e488a3743b4bf5ac329773b8a3e/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:00.880408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.891172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c012c2-ceda-459c-943c-a8c72eeba3b7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.908293 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:00.946389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857543a-bc99-42ac-ab6d-d9e7c8466206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.946985 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857543a-bc99-42ac-ab6d-d9e7c8466206 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.947266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857543a-bc99-42ac-ab6d-d9e7c8466206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.947532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857543a-bc99-42ac-ab6d-d9e7c8466206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.948161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857543a-bc99-42ac-ab6d-d9e7c8466206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.949772 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857543a-bc99-42ac-ab6d-d9e7c8466206 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.959853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1255/2481] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:00.964166 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:00.975156 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a71d3-50c8-4cc8-ab4f-905c862746b3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:00.979720 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:00.980286 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:00.980592 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:00.980859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] PATH_INFO: `/v3/projects/7299a7ea80f44e8fac2884aaa3eebfa9/users/2a964e488a3743b4bf5ac329773b8a3e/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:00.982733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7299a7ea80f44e8fac2884aaa3eebfa9, user_id=2a964e488a3743b4bf5ac329773b8a3e, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:00.985414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:00.995342 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1227/2482] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:00 2022] PUT /identity/v3/projects/7299a7ea80f44e8fac2884aaa3eebfa9/users/2a964e488a3743b4bf5ac329773b8a3e/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:01.007290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:01.007624 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:01.007904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:01.036395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] MFA Rules not processed for user `2a964e488a3743b4bf5ac329773b8a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:01.037612 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:01.103131 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1256/2483] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:01.114401 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:01.116105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:01.194347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56f39-d649-46e5-bb84-019e07a647aa admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:01.198064 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:01.198654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:01.198927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:01.199210 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:01.238497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:01.254351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:01.255783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:01.264368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1228/2484] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:01.598640 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:01.604878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:01.668016 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9270f29-ed66-486d-a6aa-ef57c576d1ac None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:01.672160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:01.672793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:01.673072 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:01.673344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:01.675038 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:01.720405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:01.733904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:01.735848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:01.744566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1257/2485] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:02.957414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:02.959383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:02.971985 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1016b4-6ebb-4a06-b522-735fb62f39b2 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:02.975859 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:02.976488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:02.976771 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:02.977040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:02.987282 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:02.988747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:03.007343 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1229/2486] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:08.232697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:08.241564 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188b7b0-5ed6-45c1-97eb-4b2f843cf10d service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:08.245227 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3a091-a0f7-45b7-a058-1b73fedf2978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:08.245810 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3a091-a0f7-45b7-a058-1b73fedf2978 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:08.246082 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3a091-a0f7-45b7-a058-1b73fedf2978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:08.246346 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3a091-a0f7-45b7-a058-1b73fedf2978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:08.248030 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-17e3a091-a0f7-45b7-a058-1b73fedf2978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:08.310395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3a091-a0f7-45b7-a058-1b73fedf2978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:08.311813 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3a091-a0f7-45b7-a058-1b73fedf2978 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:08.321424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1258/2487] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:08.352347 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:08.362788 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f2335-58f9-49e8-9e9e-c926c235cd08 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:08.367457 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:08.367982 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:08.368259 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:08.368564 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] PATH_INFO: `/v3/users/b535d9c90fbd49338d94015b6c024a73` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:08.369670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b535d9c90fbd49338d94015b6c024a73)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:08.371587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:08.580676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b535d9c90fbd49338d94015b6c024a73'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:08.581816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b535d9c90fbd49338d94015b6c024a73'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:08.593589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b535d9c90fbd49338d94015b6c024a73'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:08.600334 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b535d9c90fbd49338d94015b6c024a73'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:08.657905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b535d9c90fbd49338d94015b6c024a73'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:08.664354 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1230/2488] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:08 2022] DELETE /identity/v3/users/b535d9c90fbd49338d94015b6c024a73 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:08.669204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:08.684893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:08.684893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:08.689653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:08.690860 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:08.751627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1259/2489] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:08.761374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:08.762783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:08.824119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2be993-0f54-4e7f-a8ff-e34982f086b3 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:08.829428 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:08.829970 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:08.830704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:08.830987 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:08.841544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:08.843166 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:08.853067 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1231/2490] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:09.300875 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:09.303350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:09.320268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb37c8-81a1-4314-a181-67ba10d627af None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:09.325032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:09.325714 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:09.325999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:09.326405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] PATH_INFO: `/v3/projects/fedea7237b724f4380fbbe23158a3834` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:09.327606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedea7237b724f4380fbbe23158a3834)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:09.329948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:09.477000 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedea7237b724f4380fbbe23158a3834', 'request_id': 'req-57a10362-77f3-419f-8219-e5a0bcc4f231'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.483304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedea7237b724f4380fbbe23158a3834', 'request_id': 'req-57a10362-77f3-419f-8219-e5a0bcc4f231'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.491087 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedea7237b724f4380fbbe23158a3834', 'request_id': 'req-57a10362-77f3-419f-8219-e5a0bcc4f231'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.581937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] The token cache is being invalidate because project fedea7237b724f4380fbbe23158a3834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:09.582302 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.582869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.584375 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1260/2491] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:09 2022] DELETE /identity/v3/projects/fedea7237b724f4380fbbe23158a3834 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:09.589062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:09.599651 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd00c4f-6c46-4753-baae-2dc626c236fa service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:09.646344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:09.664383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:09.665438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:09.665775 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:09.666106 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] PATH_INFO: `/v3/users/2a964e488a3743b4bf5ac329773b8a3e` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:09.667277 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a964e488a3743b4bf5ac329773b8a3e)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:09.669646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:09.877590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a964e488a3743b4bf5ac329773b8a3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.878670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a964e488a3743b4bf5ac329773b8a3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.898385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a964e488a3743b4bf5ac329773b8a3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.908853 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a964e488a3743b4bf5ac329773b8a3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.989844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-728a85b3-b007-4d76-ae14-59c5a023a90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a964e488a3743b4bf5ac329773b8a3e'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:09.997997 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1232/2492] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:09 2022] DELETE /identity/v3/users/2a964e488a3743b4bf5ac329773b8a3e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:10.560832 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:10.562950 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:10.573953 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:10.580206 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a10362-77f3-419f-8219-e5a0bcc4f231 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:10.642399 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:10.643073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:10.643347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:10.643623 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] PATH_INFO: `/v3/projects/7299a7ea80f44e8fac2884aaa3eebfa9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:10.644872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7299a7ea80f44e8fac2884aaa3eebfa9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:10.646823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:10.732698 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7299a7ea80f44e8fac2884aaa3eebfa9', 'request_id': 'req-956ac1ff-1b85-4129-8e28-7495ce1d57a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:10.738450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7299a7ea80f44e8fac2884aaa3eebfa9', 'request_id': 'req-956ac1ff-1b85-4129-8e28-7495ce1d57a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:10.744743 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7299a7ea80f44e8fac2884aaa3eebfa9', 'request_id': 'req-956ac1ff-1b85-4129-8e28-7495ce1d57a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:10.835998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] The token cache is being invalidate because project 7299a7ea80f44e8fac2884aaa3eebfa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:10.836306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:10.836947 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-956ac1ff-1b85-4129-8e28-7495ce1d57a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:10.846633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1261/2493] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:10 2022] DELETE /identity/v3/projects/7299a7ea80f44e8fac2884aaa3eebfa9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:10.848201 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1866d-1684-48cf-bd74-fd03dce22e1c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:10.848729 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1866d-1684-48cf-bd74-fd03dce22e1c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:10.848832 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1866d-1684-48cf-bd74-fd03dce22e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:10.871576 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-58a1866d-1684-48cf-bd74-fd03dce22e1c None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:10.873205 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-58a1866d-1684-48cf-bd74-fd03dce22e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:10.961641 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1233/2494] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:10.962987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49874ff-984b-4f3f-a458-d862dfc4d438 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:10.965113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49874ff-984b-4f3f-a458-d862dfc4d438 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:10.965113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49874ff-984b-4f3f-a458-d862dfc4d438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:10.985956 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c49874ff-984b-4f3f-a458-d862dfc4d438 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:10.987301 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c49874ff-984b-4f3f-a458-d862dfc4d438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:10.996453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1262/2495] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:58:11.001302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1866d-1684-48cf-bd74-fd03dce22e1c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.011395 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1866d-1684-48cf-bd74-fd03dce22e1c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:11.017200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:11.018040 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.018388 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.018721 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.019529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:58:11.019804 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:11.021502 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:11.035850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1234/2496] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:58:11.040113 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49874ff-984b-4f3f-a458-d862dfc4d438 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.050080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49874ff-984b-4f3f-a458-d862dfc4d438 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:11.055161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:11.055782 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.056064 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.056336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.060057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:11.062043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:11.150948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1263/2497] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:11 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:11.155104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.173309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab32baf-4aed-46df-8f3f-c05be98f6739 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:11.226159 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:11.243386 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:11.244005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.244279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.260009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.260009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:11.260009 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:11.399323 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1235/2498] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:11 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:11.403414 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.413900 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4401a5-e444-43ad-b86e-8051ba7b7d7b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:11.418821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:11.419410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.419709 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.419981 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.420652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:11.422793 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:11.433919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1264/2499] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:11.437239 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.447996 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcf797-8cdd-4046-8cfd-817712f9b310 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:11.452757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffbebd-95b5-4042-aed6-7df9f4f71ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:11.453353 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffbebd-95b5-4042-aed6-7df9f4f71ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.453634 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffbebd-95b5-4042-aed6-7df9f4f71ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.453953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffbebd-95b5-4042-aed6-7df9f4f71ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.454539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffbebd-95b5-4042-aed6-7df9f4f71ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:11.456136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffbebd-95b5-4042-aed6-7df9f4f71ed7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:11.470969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1236/2500] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:58:11.475497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.488010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88658233-62df-4f0f-816f-98b69ef26892 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:11.493363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:11.494531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.494816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.496285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] PATH_INFO: `/v3/projects/25337ad465e444958d6bd972b15053c4/users/08188d5db7bb4747ada34d3905b73fc4/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.512197 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25337ad465e444958d6bd972b15053c4, user_id=08188d5db7bb4747ada34d3905b73fc4, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:11.518186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:11.621217 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1265/2501] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:11 2022] PUT /identity/v3/projects/25337ad465e444958d6bd972b15053c4/users/08188d5db7bb4747ada34d3905b73fc4/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:58:11.631919 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bfd17-cc5f-4847-b4ea-db78a03f34f6 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.632340 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bfd17-cc5f-4847-b4ea-db78a03f34f6 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.632738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bfd17-cc5f-4847-b4ea-db78a03f34f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.676252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-164bfd17-cc5f-4847-b4ea-db78a03f34f6 None None] MFA Rules not processed for user `08188d5db7bb4747ada34d3905b73fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:11.677488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-164bfd17-cc5f-4847-b4ea-db78a03f34f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:11.757030 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1237/2502] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:11.761445 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.794383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:11.827663 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985be590-5200-4e7f-960a-34199bde26bf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:11.832815 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:11.836129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:11.836129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:11.836129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:11.836129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:11.838377 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:11.943269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1266/2503] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:11 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:11.944374 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bfd17-cc5f-4847-b4ea-db78a03f34f6 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:11.955611 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bfd17-cc5f-4847-b4ea-db78a03f34f6 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.014817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.016029 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.016359 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.016682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.017348 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.019264 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.123673 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1238/2504] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:11 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:12.126494 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.137899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ddf68-f660-4f09-8367-eb32b90e013e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.143794 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.144822 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.145061 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.145388 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.146112 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.147976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.159710 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1267/2505] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:12.164128 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.175737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f2758-0923-409c-b4b2-d41f8182e1a0 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.180759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2eeca-98bb-49fd-b56a-8eca233d84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.181364 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2eeca-98bb-49fd-b56a-8eca233d84f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.181642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2eeca-98bb-49fd-b56a-8eca233d84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.181914 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2eeca-98bb-49fd-b56a-8eca233d84f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.187588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2eeca-98bb-49fd-b56a-8eca233d84f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.187588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2eeca-98bb-49fd-b56a-8eca233d84f0 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.194499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1239/2506] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:12.198708 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.209759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d93cc-0ad4-45c1-8a2a-d15e7d7e9f6d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.214898 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.215202 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.215483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.215752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] PATH_INFO: `/v3/projects/65da68cd6e1347808c0bffca010e658e/users/9f274ccc8d2d46dda7553d60ca8c9ddf/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.232545 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65da68cd6e1347808c0bffca010e658e, user_id=9f274ccc8d2d46dda7553d60ca8c9ddf, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.235263 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.315395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1268/2507] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:12 2022] PUT /identity/v3/projects/65da68cd6e1347808c0bffca010e658e/users/9f274ccc8d2d46dda7553d60ca8c9ddf/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:58:12.334540 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0ebb3-3cdf-4560-aa1b-5dd1d518377d None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.334873 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0ebb3-3cdf-4560-aa1b-5dd1d518377d None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.335148 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0ebb3-3cdf-4560-aa1b-5dd1d518377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.365612 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-7ee0ebb3-3cdf-4560-aa1b-5dd1d518377d None None] MFA Rules not processed for user `9f274ccc8d2d46dda7553d60ca8c9ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:12.366731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-7ee0ebb3-3cdf-4560-aa1b-5dd1d518377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:12.391133 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:12.431858 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1240/2508] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:12.436393 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.498320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaf6ee-6ba0-4ee9-a00e-0a2cea7b1c67 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.503006 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.503603 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.503876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.504141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.504800 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.506686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.608486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1269/2509] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:12 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:12.613381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0ebb3-3cdf-4560-aa1b-5dd1d518377d None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.624552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0ebb3-3cdf-4560-aa1b-5dd1d518377d None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.685344 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.686424 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.686710 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.686983 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.687653 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.689622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.778265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1241/2510] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:12 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:12.782980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.793567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9197463-118e-4288-871b-0614fd096a36 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.798478 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.799250 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.799587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.799916 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.800646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.802303 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.813677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1270/2511] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:12.817893 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.829164 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8202d-f9ba-46bb-bad5-56e8592f75eb admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.834891 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.835667 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.835943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.836358 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] PATH_INFO: `/v3/projects/a5ca5b0f87194e8f875f09bae1053dc6/users/ad9ec7efb2754f5db3bcc1422c50fa10/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.853595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ca5b0f87194e8f875f09bae1053dc6, user_id=ad9ec7efb2754f5db3bcc1422c50fa10, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.856562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:12.916068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1242/2512] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:12 2022] PUT /identity/v3/projects/a5ca5b0f87194e8f875f09bae1053dc6/users/ad9ec7efb2754f5db3bcc1422c50fa10/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:58:12.920041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:12.930753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd90c-b69d-4625-9340-cc1b267a431b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:12.982688 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:12.991489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312317-422b-49bc-af91-edafab6b44a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:12.992098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312317-422b-49bc-af91-edafab6b44a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:12.992379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312317-422b-49bc-af91-edafab6b44a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:12.992682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312317-422b-49bc-af91-edafab6b44a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:12.993344 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312317-422b-49bc-af91-edafab6b44a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:12.994975 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312317-422b-49bc-af91-edafab6b44a4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:13.005187 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1271/2513] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:13.009387 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:13.020295 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba12fc-f778-4c59-b69f-fc4fd9f3dede admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:13.024966 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:13.025607 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:13.025882 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:13.026154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] PATH_INFO: `/v3/projects/a5ca5b0f87194e8f875f09bae1053dc6/users/ad9ec7efb2754f5db3bcc1422c50fa10/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:13.028085 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ca5b0f87194e8f875f09bae1053dc6, user_id=ad9ec7efb2754f5db3bcc1422c50fa10, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:13.030777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:13.041741 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1243/2514] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:13 2022] PUT /identity/v3/projects/a5ca5b0f87194e8f875f09bae1053dc6/users/ad9ec7efb2754f5db3bcc1422c50fa10/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:13.051967 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:13.052254 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:13.052555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:13.084299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] MFA Rules not processed for user `ad9ec7efb2754f5db3bcc1422c50fa10`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:13.085625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:13.169111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1272/2515] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:13.177513 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:13.179265 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:13.245811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f213de-3447-4a73-bac4-c998eabe3aa2 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:13.249574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:13.250743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:13.251022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:13.251292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:13.261605 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:13.263049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:13.274888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1244/2516] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:14.513014 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:14.514305 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:14.526578 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5aad1-a858-419e-9d7e-03a990c5262f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:14.530142 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:14.530728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:14.530999 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:14.531266 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:14.586827 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:14.588339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:14.598424 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1273/2517] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:58:15.971465 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:15.972938 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:15.995093 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:16.042757 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367c018-c5b7-440b-b5dc-88b513acc075 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:16.047679 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:16.048271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:16.048584 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:16.048856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:16.050553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:16.063196 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:16.064887 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:16.075603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1245/2518] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:16.107901 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:16.109323 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:16.176125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fc1a8-58f4-42df-ab4c-f984fdf5842f service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:16.180919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:16.181541 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:16.181813 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:16.182081 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] PATH_INFO: `/v3/users/1d57ee0b19c743bfb53a4bff316a4089` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:16.183212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d57ee0b19c743bfb53a4bff316a4089)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:16.185188 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:16.199410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:16.380692 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d57ee0b19c743bfb53a4bff316a4089'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:16.389568 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d57ee0b19c743bfb53a4bff316a4089'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:16.390460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d57ee0b19c743bfb53a4bff316a4089'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:16.391343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d57ee0b19c743bfb53a4bff316a4089'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:16.457405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d57ee0b19c743bfb53a4bff316a4089'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:16.474894 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1274/2519] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:16 2022] DELETE /identity/v3/users/1d57ee0b19c743bfb53a4bff316a4089 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:16.731834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:16.744016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39158-ab68-47d3-bb7a-50a01b9db378 service placement] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:16.801229 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:16.801940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:16.802294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:16.802414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] PATH_INFO: `/v3/projects/b4281533759345469ca70cb4f152f63e` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:16.803510 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4281533759345469ca70cb4f152f63e)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:16.805450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:16.944062 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4281533759345469ca70cb4f152f63e', 'request_id': 'req-6260e160-37f2-4e74-b07d-c54ef90e527b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:16.950525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4281533759345469ca70cb4f152f63e', 'request_id': 'req-6260e160-37f2-4e74-b07d-c54ef90e527b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:16.956268 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4281533759345469ca70cb4f152f63e', 'request_id': 'req-6260e160-37f2-4e74-b07d-c54ef90e527b'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.045553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] The token cache is being invalidate because project b4281533759345469ca70cb4f152f63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:17.046187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.046785 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.049007 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1246/2520] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:16 2022] DELETE /identity/v3/projects/b4281533759345469ca70cb4f152f63e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:17.053129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:17.054503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:17.067493 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453f927-1a25-498c-807d-51c388b9ec67 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:17.124510 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:17.125145 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:17.125430 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:17.125711 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] PATH_INFO: `/v3/users/86ef566b196c4502b4b273ef3d756afa` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:17.127046 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ef566b196c4502b4b273ef3d756afa)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:17.129001 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:17.378473 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ef566b196c4502b4b273ef3d756afa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.385501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ef566b196c4502b4b273ef3d756afa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.386161 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ef566b196c4502b4b273ef3d756afa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.386890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ef566b196c4502b4b273ef3d756afa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.450024 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ef566b196c4502b4b273ef3d756afa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.468272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1275/2521] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:17 2022] DELETE /identity/v3/users/86ef566b196c4502b4b273ef3d756afa => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:17.732383 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:17.734542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:17.752763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e160-37f2-4e74-b07d-c54ef90e527b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:17.794412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:17.816057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:17.816737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:17.817311 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:17.820668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] PATH_INFO: `/v3/projects/7e33c06390294c2c81821619c6dd9d24` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:17.822200 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e33c06390294c2c81821619c6dd9d24)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:17.824172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:17.921248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e33c06390294c2c81821619c6dd9d24', 'request_id': 'req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.928875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e33c06390294c2c81821619c6dd9d24', 'request_id': 'req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:17.934267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e33c06390294c2c81821619c6dd9d24', 'request_id': 'req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:18.000068 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] The token cache is being invalidate because project 7e33c06390294c2c81821619c6dd9d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81601) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:18.000355 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:18.001525 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:18.003033 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1247/2522] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:17 2022] DELETE /identity/v3/projects/7e33c06390294c2c81821619c6dd9d24 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:19.500108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:19.503109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:19.515331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:19.558790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebe532-70b3-46a2-b417-b2f366854c73 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:19.607057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd659e-688c-48b1-b340-496ecbeacc0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:19.607703 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd659e-688c-48b1-b340-496ecbeacc0f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:19.607980 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd659e-688c-48b1-b340-496ecbeacc0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:19.608249 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd659e-688c-48b1-b340-496ecbeacc0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:19.611122 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-10bd659e-688c-48b1-b340-496ecbeacc0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:19.666843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd659e-688c-48b1-b340-496ecbeacc0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:19.668191 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd659e-688c-48b1-b340-496ecbeacc0f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:19.677404 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1276/2523] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:23.534498 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:23.535890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:23.598701 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc613-4648-4d0d-b8c8-e37137dd1fca admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:23.605609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:23.605609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:23.605609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:23.605609 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] PATH_INFO: `/v3/users/08188d5db7bb4747ada34d3905b73fc4` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:23.606010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=08188d5db7bb4747ada34d3905b73fc4)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:23.607547 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:23.784590 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08188d5db7bb4747ada34d3905b73fc4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:23.785279 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08188d5db7bb4747ada34d3905b73fc4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:23.797686 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08188d5db7bb4747ada34d3905b73fc4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:23.802913 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:23.805042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08188d5db7bb4747ada34d3905b73fc4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:23.901312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08188d5db7bb4747ada34d3905b73fc4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:23.907821 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1248/2524] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:23 2022] DELETE /identity/v3/users/08188d5db7bb4747ada34d3905b73fc4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:23.912915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:23.913395 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:23.913516 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:23.932339 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:23.933555 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:23.991887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1277/2525] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:24.001644 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:24.003016 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:24.059903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d52cca-b520-40e3-aba5-db662c5f1dfc admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:24.063552 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:24.064136 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:24.064411 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:24.064712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:24.073700 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:24.075144 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:24.085039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1249/2526] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:24.499066 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:24.500487 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:24.515699 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c9667-91e2-4a0c-a8c5-1b536ef2e2c5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:24.521350 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:24.521877 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:24.522152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:24.522509 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] PATH_INFO: `/v3/projects/25337ad465e444958d6bd972b15053c4` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:24.523695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=25337ad465e444958d6bd972b15053c4)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:24.525570 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:24.542383 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:24.667471 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25337ad465e444958d6bd972b15053c4', 'request_id': 'req-2156a87b-aaa5-426b-af77-c395b60e34fb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:24.672949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25337ad465e444958d6bd972b15053c4', 'request_id': 'req-2156a87b-aaa5-426b-af77-c395b60e34fb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:24.679850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25337ad465e444958d6bd972b15053c4', 'request_id': 'req-2156a87b-aaa5-426b-af77-c395b60e34fb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:24.775126 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] The token cache is being invalidate because project 25337ad465e444958d6bd972b15053c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:24.775408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:24.776017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:24.777531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1278/2527] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:24 2022] DELETE /identity/v3/projects/25337ad465e444958d6bd972b15053c4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:24.781453 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:24.791269 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc10f88-fae2-4060-ba3f-7c36990aaca9 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:24.846391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:24.847005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:24.847321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:24.847591 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] PATH_INFO: `/v3/users/9f274ccc8d2d46dda7553d60ca8c9ddf` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:24.848699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f274ccc8d2d46dda7553d60ca8c9ddf)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:24.850603 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:25.030843 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f274ccc8d2d46dda7553d60ca8c9ddf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.031417 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f274ccc8d2d46dda7553d60ca8c9ddf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.044161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f274ccc8d2d46dda7553d60ca8c9ddf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.051448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f274ccc8d2d46dda7553d60ca8c9ddf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.149151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f274ccc8d2d46dda7553d60ca8c9ddf'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.155478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1250/2528] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:24 2022] DELETE /identity/v3/users/9f274ccc8d2d46dda7553d60ca8c9ddf => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:58:25.567359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:25.569453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:25.587098 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a87b-aaa5-426b-af77-c395b60e34fb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:25.644934 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:25.645546 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:25.645816 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:25.646080 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] PATH_INFO: `/v3/projects/65da68cd6e1347808c0bffca010e658e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:25.647319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65da68cd6e1347808c0bffca010e658e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:25.649272 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:25.772328 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65da68cd6e1347808c0bffca010e658e', 'request_id': 'req-1862b760-b165-4785-ae83-c1f960d1e457'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.777823 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65da68cd6e1347808c0bffca010e658e', 'request_id': 'req-1862b760-b165-4785-ae83-c1f960d1e457'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.784163 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65da68cd6e1347808c0bffca010e658e', 'request_id': 'req-1862b760-b165-4785-ae83-c1f960d1e457'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.862315 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] The token cache is being invalidate because project 65da68cd6e1347808c0bffca010e658e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:25.862601 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.863212 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:25.864747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1279/2529] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:25 2022] DELETE /identity/v3/projects/65da68cd6e1347808c0bffca010e658e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:25.868678 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:25.870165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:25.883708 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f479128-f996-417c-aaf1-e3ab60a5ea64 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:25.891406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:25.939885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:25.940542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:25.941351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:25.941623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] PATH_INFO: `/v3/users/ad9ec7efb2754f5db3bcc1422c50fa10` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:25.942725 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9ec7efb2754f5db3bcc1422c50fa10)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:25.944642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:26.115385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9ec7efb2754f5db3bcc1422c50fa10'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.115991 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9ec7efb2754f5db3bcc1422c50fa10'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.129655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9ec7efb2754f5db3bcc1422c50fa10'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.136409 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9ec7efb2754f5db3bcc1422c50fa10'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.215751 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1d8ff749-0858-41ac-8185-23d253922ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9ec7efb2754f5db3bcc1422c50fa10'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.221847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1251/2530] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:25 2022] DELETE /identity/v3/users/ad9ec7efb2754f5db3bcc1422c50fa10 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:26.611964 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:26.613489 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:26.627697 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862b760-b165-4785-ae83-c1f960d1e457 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:26.661252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:26.685347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:26.685983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:26.686470 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:26.686792 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] PATH_INFO: `/v3/projects/a5ca5b0f87194e8f875f09bae1053dc6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:26.688264 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ca5b0f87194e8f875f09bae1053dc6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:26.690278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:26.783790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ca5b0f87194e8f875f09bae1053dc6', 'request_id': 'req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.790222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ca5b0f87194e8f875f09bae1053dc6', 'request_id': 'req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.796384 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ca5b0f87194e8f875f09bae1053dc6', 'request_id': 'req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.897521 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] The token cache is being invalidate because project a5ca5b0f87194e8f875f09bae1053dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:26.897741 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.898361 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2765244a-8e5e-46e6-b643-2b1fc9d79dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:26.899842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1280/2531] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:26 2022] DELETE /identity/v3/projects/a5ca5b0f87194e8f875f09bae1053dc6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:26.905815 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611087c3-60a6-445b-a8a1-575b58cdc548 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:26.907712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611087c3-60a6-445b-a8a1-575b58cdc548 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:26.907712 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611087c3-60a6-445b-a8a1-575b58cdc548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:26.926801 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-611087c3-60a6-445b-a8a1-575b58cdc548 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:26.927992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-611087c3-60a6-445b-a8a1-575b58cdc548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:26.985758 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1252/2532] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:27.048190 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee71e-f282-42fa-9acb-fb4ab379328d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.048531 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee71e-f282-42fa-9acb-fb4ab379328d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.048807 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adee71e-f282-42fa-9acb-fb4ab379328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.068311 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4adee71e-f282-42fa-9acb-fb4ab379328d None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:27.069538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4adee71e-f282-42fa-9acb-fb4ab379328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:27.077294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1281/2533] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:27.081992 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611087c3-60a6-445b-a8a1-575b58cdc548 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.092073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611087c3-60a6-445b-a8a1-575b58cdc548 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:27.096625 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:27.097211 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.097490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.097780 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.099010 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:58:27.099316 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:27.101080 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:27.112470 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1253/2534] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:58:27.116505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee71e-f282-42fa-9acb-fb4ab379328d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.125871 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adee71e-f282-42fa-9acb-fb4ab379328d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:27.131010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:27.131600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.131878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.132150 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.132850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:27.134748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:27.259085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1282/2535] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:27 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:27.263234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.273878 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd761-9962-4301-a911-c173b070b01b admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:27.286236 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:27.338075 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:27.338681 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.338961 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.339232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.339867 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:27.341811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:27.468844 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1254/2536] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:27 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:27.472971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.483128 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a5a4f-ed28-4c05-9a23-d52c75073153 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:27.487641 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:27.488228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.488539 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.488812 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.489469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:27.491075 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:27.500734 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1283/2537] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:27.504599 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.514834 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f9515-1301-42de-9ae4-648ca280d636 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:27.519288 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb64b7-2f02-4c8c-bde8-85738ca8c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:27.519865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb64b7-2f02-4c8c-bde8-85738ca8c23e admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.520142 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb64b7-2f02-4c8c-bde8-85738ca8c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.520412 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb64b7-2f02-4c8c-bde8-85738ca8c23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.521066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb64b7-2f02-4c8c-bde8-85738ca8c23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:27.523258 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb64b7-2f02-4c8c-bde8-85738ca8c23e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:27.533001 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1255/2538] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:27.536957 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.547071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e56ac4-c7f8-492c-9e5f-6ba3712ea64a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:27.551588 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:27.552224 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.552540 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.552819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] PATH_INFO: `/v3/projects/8dec655a69d446f48a8d00600a947ddf/users/8b316a92550a419fa269fb7991c7fdb8/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.567045 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dec655a69d446f48a8d00600a947ddf, user_id=8b316a92550a419fa269fb7991c7fdb8, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:27.570248 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:27.656949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1284/2539] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:27 2022] PUT /identity/v3/projects/8dec655a69d446f48a8d00600a947ddf/users/8b316a92550a419fa269fb7991c7fdb8/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:27.668103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965765f-ba84-4ad1-a8b0-ccc349598740 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.668393 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965765f-ba84-4ad1-a8b0-ccc349598740 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.668699 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965765f-ba84-4ad1-a8b0-ccc349598740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.696561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-0965765f-ba84-4ad1-a8b0-ccc349598740 None None] MFA Rules not processed for user `8b316a92550a419fa269fb7991c7fdb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:27.697744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0965765f-ba84-4ad1-a8b0-ccc349598740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:27.760053 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1256/2540] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:58:27.764532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.827567 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b37ef4-8f0a-48d8-94bc-93162a2353b0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:27.832109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:27.832754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:27.833028 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:27.833313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:27.834592 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:27.836522 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:27.841814 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:27.933049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1285/2541] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:27 2022] POST /identity/v3/projects => generated 393 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:27.937157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965765f-ba84-4ad1-a8b0-ccc349598740 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:27.948187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965765f-ba84-4ad1-a8b0-ccc349598740 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:28.002929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:28.003526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.003831 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.004099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.004755 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:28.007299 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:28.074561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1257/2542] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:27 2022] POST /identity/v3/users => generated 303 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:28.078633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:28.089668 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82127e-4267-4c33-be0b-5858457937fa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:28.094694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:28.095285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.095594 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.095899 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.096587 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:28.098192 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:28.108907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1286/2543] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:28.113027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:28.126731 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e0490-a008-4a2e-890a-ae61bf575642 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:28.131617 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:28.132252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.132561 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.132828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] PATH_INFO: `/v3/projects/96fa53f9516242fcbadb2878f5c8fb96/users/1d6fb7ec2e3e4dc0aba2bc0b93a3b99f/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.144796 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:28.147705 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fa53f9516242fcbadb2878f5c8fb96, user_id=1d6fb7ec2e3e4dc0aba2bc0b93a3b99f, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:28.150381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:28.211397 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1258/2544] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:28 2022] PUT /identity/v3/projects/96fa53f9516242fcbadb2878f5c8fb96/users/1d6fb7ec2e3e4dc0aba2bc0b93a3b99f/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:28.215499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:28.226172 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5135d2c-20b4-4bd8-b976-f5f2d1c538be admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:28.281577 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7442-5674-40ff-9f71-388481c76528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:28.282180 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7442-5674-40ff-9f71-388481c76528 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.282456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7442-5674-40ff-9f71-388481c76528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.282725 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7442-5674-40ff-9f71-388481c76528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.283359 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7442-5674-40ff-9f71-388481c76528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:28.284969 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7442-5674-40ff-9f71-388481c76528 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:28.295479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1287/2545] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 07:58:28.299588 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:28.310449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45b7d3-b384-46a2-91ea-f4d61ae138c1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:28.315141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:28.315772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.316049 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.316318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] PATH_INFO: `/v3/projects/96fa53f9516242fcbadb2878f5c8fb96/users/1d6fb7ec2e3e4dc0aba2bc0b93a3b99f/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.318292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fa53f9516242fcbadb2878f5c8fb96, user_id=1d6fb7ec2e3e4dc0aba2bc0b93a3b99f, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:28.320999 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:28.331008 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1259/2546] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:28 2022] PUT /identity/v3/projects/96fa53f9516242fcbadb2878f5c8fb96/users/1d6fb7ec2e3e4dc0aba2bc0b93a3b99f/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:28.340930 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.341213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.341483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.369932 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] MFA Rules not processed for user `1d6fb7ec2e3e4dc0aba2bc0b93a3b99f`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:28.371120 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:28.438345 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1288/2547] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:28.449171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:28.450847 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:28.507058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffa935-afef-4eb4-964a-0ea07156d469 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:28.510736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:28.511325 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.511598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.511865 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.520665 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:28.522099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:28.531372 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1260/2548] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:28.577498 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:28.578887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:28.591048 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8057ee-2cdb-42b6-b5a8-9e16c4b8de1e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:28.594629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e8b6-9bd8-4f77-b244-2de42c9112ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:28.595211 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e8b6-9bd8-4f77-b244-2de42c9112ba service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:28.595483 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e8b6-9bd8-4f77-b244-2de42c9112ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:28.595747 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e8b6-9bd8-4f77-b244-2de42c9112ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:28.649605 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:28.651852 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e8b6-9bd8-4f77-b244-2de42c9112ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:28.653338 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e8b6-9bd8-4f77-b244-2de42c9112ba service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:28.662650 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1289/2549] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:33.296763 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:33.359151 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c7795-a10f-4a6e-9b93-2c29c6b3d310 service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:33.363655 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:33.364267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:33.364572 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:33.364898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] PATH_INFO: `/v3/users/8b316a92550a419fa269fb7991c7fdb8` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:33.365960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b316a92550a419fa269fb7991c7fdb8)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:33.367868 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:33.556039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b316a92550a419fa269fb7991c7fdb8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:33.556669 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b316a92550a419fa269fb7991c7fdb8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:33.568969 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b316a92550a419fa269fb7991c7fdb8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:33.575935 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b316a92550a419fa269fb7991c7fdb8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:33.680176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b316a92550a419fa269fb7991c7fdb8'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:33.682368 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:33.686541 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1261/2550] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:33 2022] DELETE /identity/v3/users/8b316a92550a419fa269fb7991c7fdb8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:33.691231 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:33.691732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:33.691844 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:33.712041 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:33.717576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:33.771621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1290/2551] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:33.781022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:33.782472 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:33.840141 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529571d-b576-4141-943f-8ed88742d628 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:33.843717 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:33.844309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:33.844621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:33.844906 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:33.853640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:33.855130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:33.864511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1262/2552] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:58:34.285566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:34.287515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:34.300922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653258b4-8985-4905-a9cd-9fcae3909718 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:34.306451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:34.307198 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:34.307479 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:34.307750 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] PATH_INFO: `/v3/projects/8dec655a69d446f48a8d00600a947ddf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:34.308919 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dec655a69d446f48a8d00600a947ddf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:34.310859 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:34.411468 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dec655a69d446f48a8d00600a947ddf', 'request_id': 'req-fc563a28-4f2f-48eb-aff0-094e16003fb0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.417763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dec655a69d446f48a8d00600a947ddf', 'request_id': 'req-fc563a28-4f2f-48eb-aff0-094e16003fb0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.423933 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dec655a69d446f48a8d00600a947ddf', 'request_id': 'req-fc563a28-4f2f-48eb-aff0-094e16003fb0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.500629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] The token cache is being invalidate because project 8dec655a69d446f48a8d00600a947ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:34.500915 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.501508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.503012 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1291/2553] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:34 2022] DELETE /identity/v3/projects/8dec655a69d446f48a8d00600a947ddf => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:34.507005 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:34.516536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406e901-1ff0-4f30-8faf-2e1cab329774 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:34.571271 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:34.571888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:34.572167 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:34.572455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] PATH_INFO: `/v3/users/1d6fb7ec2e3e4dc0aba2bc0b93a3b99f` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:34.573558 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6fb7ec2e3e4dc0aba2bc0b93a3b99f)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:34.575466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:34.779497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6fb7ec2e3e4dc0aba2bc0b93a3b99f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.780072 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6fb7ec2e3e4dc0aba2bc0b93a3b99f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.793341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6fb7ec2e3e4dc0aba2bc0b93a3b99f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.800157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6fb7ec2e3e4dc0aba2bc0b93a3b99f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.851953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1ea42a43-d089-40cf-a8df-892dc1c9b0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6fb7ec2e3e4dc0aba2bc0b93a3b99f'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:34.858104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1263/2554] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:34 2022] DELETE /identity/v3/users/1d6fb7ec2e3e4dc0aba2bc0b93a3b99f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:35.217604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:35.219013 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:35.232252 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc563a28-4f2f-48eb-aff0-094e16003fb0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:35.289515 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:35.290343 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.290620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.290890 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] PATH_INFO: `/v3/projects/96fa53f9516242fcbadb2878f5c8fb96` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.291991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fa53f9516242fcbadb2878f5c8fb96)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:35.293922 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:35.316108 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:35.399673 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fa53f9516242fcbadb2878f5c8fb96', 'request_id': 'req-5ecb9b52-52b8-45ef-888b-039ccc35e846'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:35.405160 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fa53f9516242fcbadb2878f5c8fb96', 'request_id': 'req-5ecb9b52-52b8-45ef-888b-039ccc35e846'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:35.411602 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fa53f9516242fcbadb2878f5c8fb96', 'request_id': 'req-5ecb9b52-52b8-45ef-888b-039ccc35e846'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:35.484853 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] The token cache is being invalidate because project 96fa53f9516242fcbadb2878f5c8fb96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:35.485141 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:35.485754 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5ecb9b52-52b8-45ef-888b-039ccc35e846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:35.487218 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1292/2555] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:35 2022] DELETE /identity/v3/projects/96fa53f9516242fcbadb2878f5c8fb96 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:35.492662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8e7d-ce25-4564-84a1-33c66d84b3d0 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.492952 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8e7d-ce25-4564-84a1-33c66d84b3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.493231 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8e7d-ce25-4564-84a1-33c66d84b3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.514294 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-220e8e7d-ce25-4564-84a1-33c66d84b3d0 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:35.515477 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-220e8e7d-ce25-4564-84a1-33c66d84b3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:35.531839 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:35.573512 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1264/2556] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:35.582347 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c17f42-a5e8-4ffc-98f3-47a6cda83243 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.582633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c17f42-a5e8-4ffc-98f3-47a6cda83243 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.582907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c17f42-a5e8-4ffc-98f3-47a6cda83243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.603010 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e9c17f42-a5e8-4ffc-98f3-47a6cda83243 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:35.604194 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e9c17f42-a5e8-4ffc-98f3-47a6cda83243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:35.611949 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1293/2557] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:35.616790 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e8e7d-ce25-4564-84a1-33c66d84b3d0 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:35.626305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e8e7d-ce25-4564-84a1-33c66d84b3d0 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:35.631421 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:35.632004 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.632280 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.632586 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.633234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:58:35.633539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:35.635110 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:35.646312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1265/2558] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:58:35.650658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c17f42-a5e8-4ffc-98f3-47a6cda83243 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:35.659715 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c17f42-a5e8-4ffc-98f3-47a6cda83243 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:35.664372 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:35.667412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.667412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.667412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.667412 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:35.668325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:35.783864 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1294/2559] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:35 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:35.788837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:35.798943 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19b672-507b-4bd6-8d92-f66fa4878f63 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:35.854682 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:35.855281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.855562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.855836 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.856518 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:35.858448 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:35.935483 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1266/2560] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:35 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:35.939607 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:35.949907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40297b-433e-42ff-b000-68889602fd90 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:35.954469 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:35.957606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.957606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.957606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.957606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:35.958123 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:35.967497 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1295/2561] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:35.971272 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:35.981646 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b38bff-76cf-4ce9-8272-40f91616a6f7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:35.986403 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92302a-156f-45eb-b87d-06426b348907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:35.986988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92302a-156f-45eb-b87d-06426b348907 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:35.987266 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92302a-156f-45eb-b87d-06426b348907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:35.987535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92302a-156f-45eb-b87d-06426b348907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:35.988163 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92302a-156f-45eb-b87d-06426b348907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:35.990366 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92302a-156f-45eb-b87d-06426b348907 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:36.000916 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1267/2562] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:36.004881 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:36.014591 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947ecc7-0eab-4be5-97b5-f7a21b9a8755 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:36.019140 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:36.019769 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.020043 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.020312 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] PATH_INFO: `/v3/projects/673fb7338d014283b874f27eadf137da/users/d07c74e3730f4d01957852680bb437d6/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.034504 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] RBAC: Authorizing `identity:create_grant(project_id=673fb7338d014283b874f27eadf137da, user_id=d07c74e3730f4d01957852680bb437d6, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:36.038065 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:36.106733 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1296/2563] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:36 2022] PUT /identity/v3/projects/673fb7338d014283b874f27eadf137da/users/d07c74e3730f4d01957852680bb437d6/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:36.120232 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd50ca2-c673-4e12-b506-2d507745c04c None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.120549 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd50ca2-c673-4e12-b506-2d507745c04c None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.120828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd50ca2-c673-4e12-b506-2d507745c04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.148752 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-dbd50ca2-c673-4e12-b506-2d507745c04c None None] MFA Rules not processed for user `d07c74e3730f4d01957852680bb437d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:36.149954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-dbd50ca2-c673-4e12-b506-2d507745c04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:36.212131 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1268/2564] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:36.216666 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:36.277505 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcd6a5-a2c9-46ba-b198-e4a699c1683e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:36.282179 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:36.282763 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.283035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.283299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.283912 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:36.285819 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:36.383893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1297/2565] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:36 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:36.388066 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd50ca2-c673-4e12-b506-2d507745c04c None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:36.399114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd50ca2-c673-4e12-b506-2d507745c04c None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:36.411172 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:36.455696 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:36.456318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.456628 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.456898 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.457542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:36.460257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:36.573524 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1269/2566] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:36 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:36.577629 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:36.588442 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57f1e-b391-4714-a60b-3ec2b556bbd9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:36.592962 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:36.593576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.593845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.594110 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.594764 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:36.596387 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:36.607049 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1298/2567] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:36.610864 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:36.620615 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22c03-afb3-4668-a67f-fbe446bdd2b5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:36.625204 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e6acd-93f6-4df2-a56e-e381191385a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:36.625957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6acd-93f6-4df2-a56e-e381191385a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.626092 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6acd-93f6-4df2-a56e-e381191385a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.626317 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6acd-93f6-4df2-a56e-e381191385a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.626953 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e6acd-93f6-4df2-a56e-e381191385a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:36.628559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e6acd-93f6-4df2-a56e-e381191385a1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:36.638941 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1270/2568] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:36.642783 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:36.653171 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedab05-5b15-4a19-b2d8-722a4f84f83e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:36.658753 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:36.659405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.659682 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.665420 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] PATH_INFO: `/v3/projects/c9e20ba030a84c18bf0ca809d845ea41/users/b860b0b70f1449c58f7aa04e04dbdb81/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.674849 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e20ba030a84c18bf0ca809d845ea41, user_id=b860b0b70f1449c58f7aa04e04dbdb81, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:36.677621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:36.680651 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:36.798094 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1299/2569] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:36 2022] PUT /identity/v3/projects/c9e20ba030a84c18bf0ca809d845ea41/users/b860b0b70f1449c58f7aa04e04dbdb81/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:36.809422 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e97d-9ebd-441e-94cd-aec4cb471ea1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.809704 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e97d-9ebd-441e-94cd-aec4cb471ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.809977 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e97d-9ebd-441e-94cd-aec4cb471ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.838225 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-bd42e97d-9ebd-441e-94cd-aec4cb471ea1 None None] MFA Rules not processed for user `b860b0b70f1449c58f7aa04e04dbdb81`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:36.839494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-bd42e97d-9ebd-441e-94cd-aec4cb471ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:36.902856 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1271/2570] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:36.907439 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:36.968737 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148ef6f-e857-4406-b76b-46ce077a2382 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:36.973425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:36.974051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:36.974331 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:36.974600 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:36.975215 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:36.977222 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.076001 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1300/2571] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:36 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:37.079959 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42e97d-9ebd-441e-94cd-aec4cb471ea1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:37.090574 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42e97d-9ebd-441e-94cd-aec4cb471ea1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:37.147031 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:37.147635 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.147910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.148176 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.148851 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:37.150754 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.234161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1272/2572] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:37 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:37.238228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:37.249319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e384de-5172-46d8-ae78-0334386a28f7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:37.254022 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:37.254959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.254959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.255281 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.255748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:37.257379 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.267845 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1301/2573] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:37.271823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:37.281733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101ca7d-f98d-41f2-b249-139160cccaa5 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:37.286228 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:37.287369 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.287642 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.287905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] PATH_INFO: `/v3/projects/1c14517e91f044ecb91fbd2461d92b93/users/7abf08740a1d4c428492a2eb52af3ce4/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.299887 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:37.303400 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c14517e91f044ecb91fbd2461d92b93, user_id=7abf08740a1d4c428492a2eb52af3ce4, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:37.306105 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.382707 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1273/2574] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:37 2022] PUT /identity/v3/projects/1c14517e91f044ecb91fbd2461d92b93/users/7abf08740a1d4c428492a2eb52af3ce4/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:37.386690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:37.396876 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fc0de-8489-431e-843d-e31ed2642f9c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:37.452341 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb77312-a702-46b0-a8f2-0e1a00e95641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:37.452965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb77312-a702-46b0-a8f2-0e1a00e95641 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.453386 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb77312-a702-46b0-a8f2-0e1a00e95641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.453658 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb77312-a702-46b0-a8f2-0e1a00e95641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.454286 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb77312-a702-46b0-a8f2-0e1a00e95641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:37.455864 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb77312-a702-46b0-a8f2-0e1a00e95641 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.465620 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1302/2575] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:37.469925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:37.480730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e46c0-c688-4829-9c4f-cc12d5f67d2e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:37.485300 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:37.485875 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.486153 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.486423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] PATH_INFO: `/v3/projects/1c14517e91f044ecb91fbd2461d92b93/users/7abf08740a1d4c428492a2eb52af3ce4/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.488322 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c14517e91f044ecb91fbd2461d92b93, user_id=7abf08740a1d4c428492a2eb52af3ce4, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:37.491594 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.501598 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1274/2576] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:37 2022] PUT /identity/v3/projects/1c14517e91f044ecb91fbd2461d92b93/users/7abf08740a1d4c428492a2eb52af3ce4/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:58:37.511721 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.512009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.512287 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.540360 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] MFA Rules not processed for user `7abf08740a1d4c428492a2eb52af3ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:37.541593 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:37.591920 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:37.610032 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1303/2577] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:37.621207 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:37.622925 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:37.683046 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb203-6c82-400a-89ac-28756c40ef82 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:37.686670 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:37.687263 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.687538 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.687807 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.696639 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:37.698048 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.707733 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1275/2578] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:37.831532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:37.833001 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:37.845428 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814521f0-f2b5-47f8-957d-59f4d7c0c36d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:37.849625 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffddb3e-e434-4580-ab45-608dfe97d9e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:37.850213 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffddb3e-e434-4580-ab45-608dfe97d9e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:37.850491 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffddb3e-e434-4580-ab45-608dfe97d9e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:37.850759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffddb3e-e434-4580-ab45-608dfe97d9e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:37.906475 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffddb3e-e434-4580-ab45-608dfe97d9e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:37.907911 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffddb3e-e434-4580-ab45-608dfe97d9e8 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:37.917501 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1304/2579] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:41.774104 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:41.835175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a9b7d-f70f-4073-8e35-be692de5726b service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:41.839647 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:41.840252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:41.840556 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:41.840823 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] PATH_INFO: `/v3/users/d07c74e3730f4d01957852680bb437d6` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:41.841910 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07c74e3730f4d01957852680bb437d6)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:41.843793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:41.978888 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07c74e3730f4d01957852680bb437d6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:41.979463 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07c74e3730f4d01957852680bb437d6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:41.992018 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07c74e3730f4d01957852680bb437d6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:41.998779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07c74e3730f4d01957852680bb437d6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:42.056664 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07c74e3730f4d01957852680bb437d6'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:42.058746 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:42.062862 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1276/2580] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:41 2022] DELETE /identity/v3/users/d07c74e3730f4d01957852680bb437d6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:42.067402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:42.067882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:42.067992 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:42.087132 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:42.088320 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:42.151053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1305/2581] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:42.161430 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:42.163438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:42.219332 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542dae7-fab6-4d59-944b-b6c907c6d519 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:42.222915 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:42.223499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:42.223772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:42.224037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:42.233380 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:42.234736 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:42.243945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1277/2582] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:42.675425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:42.676910 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:42.689958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb275087-9f3e-43e7-a67c-2309881bd287 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:42.695060 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:42.695686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:42.695958 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:42.696249 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] PATH_INFO: `/v3/projects/673fb7338d014283b874f27eadf137da` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:42.697408 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=673fb7338d014283b874f27eadf137da)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:42.699310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:42.816306 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673fb7338d014283b874f27eadf137da', 'request_id': 'req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:42.822671 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673fb7338d014283b874f27eadf137da', 'request_id': 'req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:42.829310 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673fb7338d014283b874f27eadf137da', 'request_id': 'req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:42.896126 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] The token cache is being invalidate because project 673fb7338d014283b874f27eadf137da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:42.896410 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:42.897036 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:42.898532 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1306/2583] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:42 2022] DELETE /identity/v3/projects/673fb7338d014283b874f27eadf137da => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:42.902515 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:42.912073 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91b4ca-9769-47e1-af84-325b66933400 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:42.968491 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:42.969179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:42.969464 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:42.969737 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] PATH_INFO: `/v3/users/b860b0b70f1449c58f7aa04e04dbdb81` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:42.970841 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b860b0b70f1449c58f7aa04e04dbdb81)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:42.972816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:43.145526 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b860b0b70f1449c58f7aa04e04dbdb81'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.146175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b860b0b70f1449c58f7aa04e04dbdb81'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.158423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b860b0b70f1449c58f7aa04e04dbdb81'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.166160 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b860b0b70f1449c58f7aa04e04dbdb81'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.223034 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b860b0b70f1449c58f7aa04e04dbdb81'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.229449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1278/2584] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:42 2022] DELETE /identity/v3/users/b860b0b70f1449c58f7aa04e04dbdb81 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:43.599621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:43.601186 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:43.615369 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9cfc7-f037-41cc-a384-ad33d4562ef5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:43.625260 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:43.673739 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:43.674299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:43.674604 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:43.674878 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] PATH_INFO: `/v3/projects/c9e20ba030a84c18bf0ca809d845ea41` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:43.675996 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e20ba030a84c18bf0ca809d845ea41)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:43.677936 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:43.799233 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e20ba030a84c18bf0ca809d845ea41', 'request_id': 'req-680dc97e-5259-4580-8786-3d17fb7dbbff'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.805308 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e20ba030a84c18bf0ca809d845ea41', 'request_id': 'req-680dc97e-5259-4580-8786-3d17fb7dbbff'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.811643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e20ba030a84c18bf0ca809d845ea41', 'request_id': 'req-680dc97e-5259-4580-8786-3d17fb7dbbff'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.895869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] The token cache is being invalidate because project c9e20ba030a84c18bf0ca809d845ea41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:43.896156 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.896790 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:43.898319 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1307/2585] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:43 2022] DELETE /identity/v3/projects/c9e20ba030a84c18bf0ca809d845ea41 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:43.904051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:43.904051 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:43.917473 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3c1d8-3f0f-45c0-aa5f-a38bd62a66cd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:43.936058 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:43.973091 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:43.973668 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:43.973945 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:43.974219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] PATH_INFO: `/v3/users/7abf08740a1d4c428492a2eb52af3ce4` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:43.975320 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abf08740a1d4c428492a2eb52af3ce4)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:43.977774 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:44.137529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abf08740a1d4c428492a2eb52af3ce4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.138161 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abf08740a1d4c428492a2eb52af3ce4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.150219 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abf08740a1d4c428492a2eb52af3ce4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.157098 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abf08740a1d4c428492a2eb52af3ce4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.215743 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-14bfe8ae-8965-48b0-a8e2-a6f2f410abe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abf08740a1d4c428492a2eb52af3ce4'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.222015 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1279/2586] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:43 2022] DELETE /identity/v3/users/7abf08740a1d4c428492a2eb52af3ce4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:44.611171 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:44.612729 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:44.626937 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dc97e-5259-4580-8786-3d17fb7dbbff admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:44.685536 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:44.686159 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:44.686435 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:44.686707 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] PATH_INFO: `/v3/projects/1c14517e91f044ecb91fbd2461d92b93` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:44.687809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c14517e91f044ecb91fbd2461d92b93)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:44.689732 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:44.789884 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:44.792820 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c14517e91f044ecb91fbd2461d92b93', 'request_id': 'req-416400bc-f576-4eac-9f3e-6b0f9e071b1d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.798088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c14517e91f044ecb91fbd2461d92b93', 'request_id': 'req-416400bc-f576-4eac-9f3e-6b0f9e071b1d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.804694 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c14517e91f044ecb91fbd2461d92b93', 'request_id': 'req-416400bc-f576-4eac-9f3e-6b0f9e071b1d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.867940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] The token cache is being invalidate because project 1c14517e91f044ecb91fbd2461d92b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:44.873317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.873317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-416400bc-f576-4eac-9f3e-6b0f9e071b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:44.873317 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1308/2587] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:44 2022] DELETE /identity/v3/projects/1c14517e91f044ecb91fbd2461d92b93 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:44.876381 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb4e7-0b33-4913-9f1a-23e5df95d058 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:44.876688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb4e7-0b33-4913-9f1a-23e5df95d058 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:44.876962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb4e7-0b33-4913-9f1a-23e5df95d058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:44.898446 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-512bb4e7-0b33-4913-9f1a-23e5df95d058 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:44.902687 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-512bb4e7-0b33-4913-9f1a-23e5df95d058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:44.956250 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1280/2588] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:44.965236 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9e80-faeb-4362-82f3-70e99b8638d6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:44.965548 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9e80-faeb-4362-82f3-70e99b8638d6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:44.965821 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9e80-faeb-4362-82f3-70e99b8638d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:44.985073 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4caa9e80-faeb-4362-82f3-70e99b8638d6 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:44.986269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4caa9e80-faeb-4362-82f3-70e99b8638d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:44.994139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1309/2589] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:44.998632 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb4e7-0b33-4913-9f1a-23e5df95d058 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.008562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb4e7-0b33-4913-9f1a-23e5df95d058 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.013022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.013597 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.013869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.014134 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.014765 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:58:45.015057 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.016657 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.028341 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1281/2590] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:58:45.032809 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa9e80-faeb-4362-82f3-70e99b8638d6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.042246 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa9e80-faeb-4362-82f3-70e99b8638d6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.046843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.047423 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.047702 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.047974 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.048643 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.050538 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.161796 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1310/2591] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:45 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:45.166335 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.176391 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5433e-7f48-45de-aef2-c9b9de5a8036 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.203214 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:45.233305 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.233907 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.234187 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.234461 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.235078 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.237027 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.291252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1282/2592] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:45 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:45.302365 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.306425 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19550fd7-cda6-47e6-b62d-6b42616ba664 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.311139 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.311759 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.312040 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.312313 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.312982 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.314566 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.325168 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1311/2593] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:45.329022 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.338905 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5a60-d62f-4048-a6a1-1206cb974ee8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.343455 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d6ea7-42fb-4fe2-b0cd-d30a91b91d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.344039 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6ea7-42fb-4fe2-b0cd-d30a91b91d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.344321 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6ea7-42fb-4fe2-b0cd-d30a91b91d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.344623 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d6ea7-42fb-4fe2-b0cd-d30a91b91d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.345257 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d6ea7-42fb-4fe2-b0cd-d30a91b91d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.346850 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d6ea7-42fb-4fe2-b0cd-d30a91b91d1f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.364312 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1283/2594] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:45.364513 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.377389 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1fa45-3215-48e9-9c94-021374fe0150 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.382636 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.383278 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.383557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.383830 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] PATH_INFO: `/v3/projects/0111cfb491e3407c8338c083edf1a66f/users/37a7218761f44a3d86146c463fc55a27/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.398456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0111cfb491e3407c8338c083edf1a66f, user_id=37a7218761f44a3d86146c463fc55a27, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.401152 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.456817 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1312/2595] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:45 2022] PUT /identity/v3/projects/0111cfb491e3407c8338c083edf1a66f/users/37a7218761f44a3d86146c463fc55a27/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:45.469377 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89dc1b-6b16-432f-9c79-4eb36199ebdb None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.469660 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89dc1b-6b16-432f-9c79-4eb36199ebdb None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.469954 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89dc1b-6b16-432f-9c79-4eb36199ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.499738 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-3a89dc1b-6b16-432f-9c79-4eb36199ebdb None None] MFA Rules not processed for user `37a7218761f44a3d86146c463fc55a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:45.500978 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3a89dc1b-6b16-432f-9c79-4eb36199ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:45.563577 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1284/2596] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:45.567987 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.632861 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a09a4-18c1-4cbd-ab47-8796c170bcd1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.637481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.638078 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.638354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.638621 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.639256 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.641307 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.709450 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1313/2597] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:45 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:45.713575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89dc1b-6b16-432f-9c79-4eb36199ebdb None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.724252 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89dc1b-6b16-432f-9c79-4eb36199ebdb None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.779890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.780536 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.780817 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.781086 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.781777 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.783676 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.897060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1285/2598] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:45 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:45.901649 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.912009 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa816818-c60a-49d3-b0b1-8f11bdb47c9c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.917490 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.918076 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.918352 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.918619 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.919269 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.920869 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:45.931298 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1314/2599] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:45.935500 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:45.945694 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b78d1-67a1-4283-9621-2f74e7933cb8 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:45.950246 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:45.950883 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:45.951157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:45.953431 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] PATH_INFO: `/v3/projects/9c3ec335368d4dbfa6bcb76e434e99b7/users/4651c9491d0f43dabf050a1fc13d5043/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:45.966449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3ec335368d4dbfa6bcb76e434e99b7, user_id=4651c9491d0f43dabf050a1fc13d5043, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:45.969119 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:46.034213 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1286/2600] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:45 2022] PUT /identity/v3/projects/9c3ec335368d4dbfa6bcb76e434e99b7/users/4651c9491d0f43dabf050a1fc13d5043/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:46.038290 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:46.049253 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932409a-a3cc-4b04-a0ef-5a54e9f65c86 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:46.091111 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:46.106403 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00579bd5-1d5c-43ae-9745-ad7b67082de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:46.112626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579bd5-1d5c-43ae-9745-ad7b67082de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:46.112626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579bd5-1d5c-43ae-9745-ad7b67082de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:46.112626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579bd5-1d5c-43ae-9745-ad7b67082de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:46.112626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00579bd5-1d5c-43ae-9745-ad7b67082de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:46.112626 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00579bd5-1d5c-43ae-9745-ad7b67082de7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:46.119285 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1315/2601] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:46.123466 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:46.128830 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:46.134622 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a59ba-f450-4544-9c60-b545445c8a5e admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:46.139237 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:46.139870 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:46.140146 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:46.140416 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] PATH_INFO: `/v3/projects/9c3ec335368d4dbfa6bcb76e434e99b7/users/4651c9491d0f43dabf050a1fc13d5043/roles/cf59326ec88f4f0a8360d606d4a06a18` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:46.142349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3ec335368d4dbfa6bcb76e434e99b7, user_id=4651c9491d0f43dabf050a1fc13d5043, role_id=cf59326ec88f4f0a8360d606d4a06a18)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:46.145006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:46.155559 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1287/2602] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:46 2022] PUT /identity/v3/projects/9c3ec335368d4dbfa6bcb76e434e99b7/users/4651c9491d0f43dabf050a1fc13d5043/roles/cf59326ec88f4f0a8360d606d4a06a18 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:46.165926 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c559c8-2e74-4fdd-82d4-7de462f29aef None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:46.166209 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c559c8-2e74-4fdd-82d4-7de462f29aef None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:46.166477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c559c8-2e74-4fdd-82d4-7de462f29aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:46.193951 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-65c559c8-2e74-4fdd-82d4-7de462f29aef None None] MFA Rules not processed for user `4651c9491d0f43dabf050a1fc13d5043`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:46.195138 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-65c559c8-2e74-4fdd-82d4-7de462f29aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:46.261223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1316/2603] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:58:46.272723 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:46.275171 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:46.332242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ff8a-4982-4a21-a4cc-2bdb466228b1 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:46.335885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:46.337099 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:46.337373 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:46.337640 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:46.346309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:46.347726 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:46.356885 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1288/2604] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:46.649653 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c559c8-2e74-4fdd-82d4-7de462f29aef None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:46.659752 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c559c8-2e74-4fdd-82d4-7de462f29aef None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:46.663453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7d03-434b-45dc-9edc-676164c53363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:46.664050 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7d03-434b-45dc-9edc-676164c53363 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:46.664364 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7d03-434b-45dc-9edc-676164c53363 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:46.665006 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7d03-434b-45dc-9edc-676164c53363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:46.721736 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab7d03-434b-45dc-9edc-676164c53363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:46.723204 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab7d03-434b-45dc-9edc-676164c53363 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:46.732243 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1317/2605] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:53.128101 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:53.189059 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124048c-00f2-4780-b693-9e92d11c0fcb service cinder] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:53.193555 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:53.194165 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:53.194442 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:53.194711 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] PATH_INFO: `/v3/users/37a7218761f44a3d86146c463fc55a27` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:53.195825 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a7218761f44a3d86146c463fc55a27)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:53.197759 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:53.361797 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a7218761f44a3d86146c463fc55a27'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:53.362378 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a7218761f44a3d86146c463fc55a27'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:53.374234 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a7218761f44a3d86146c463fc55a27'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:53.381044 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a7218761f44a3d86146c463fc55a27'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:53.449811 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a7218761f44a3d86146c463fc55a27'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:53.456157 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1289/2606] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:53 2022] DELETE /identity/v3/users/37a7218761f44a3d86146c463fc55a27 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:53.462174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:53.462174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:53.462174 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:53.480499 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:53.481686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:53.540125 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1318/2607] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:53.549779 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:53.551154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:53.565545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:53.608126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feabdc-d363-4e7c-8109-a490aed4c5fd admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:53.611713 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:53.612351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:53.612608 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:53.612923 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:53.622100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:53.623505 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:53.632988 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1290/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:58:54.024366 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:54.025893 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:54.035149 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:54.040017 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec924dca-dd40-4da9-875b-eecb50a7643e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:54.044268 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:54.044941 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:54.045215 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:54.045488 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] PATH_INFO: `/v3/projects/0111cfb491e3407c8338c083edf1a66f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:54.046686 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0111cfb491e3407c8338c083edf1a66f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:54.049223 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:54.176779 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0111cfb491e3407c8338c083edf1a66f', 'request_id': 'req-aadc6d20-0f9b-4635-981a-4924af1e0a7d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.182526 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0111cfb491e3407c8338c083edf1a66f', 'request_id': 'req-aadc6d20-0f9b-4635-981a-4924af1e0a7d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.188896 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0111cfb491e3407c8338c083edf1a66f', 'request_id': 'req-aadc6d20-0f9b-4635-981a-4924af1e0a7d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.248846 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] The token cache is being invalidate because project 0111cfb491e3407c8338c083edf1a66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:54.249129 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.249731 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.251235 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1319/2609] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:54 2022] DELETE /identity/v3/projects/0111cfb491e3407c8338c083edf1a66f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:54.255385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:54.264948 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55364f1-f485-4d2d-af34-92c17f36fd1e service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:54.320675 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:54.321292 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:54.321562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:54.321824 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] PATH_INFO: `/v3/users/4651c9491d0f43dabf050a1fc13d5043` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:54.323511 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4651c9491d0f43dabf050a1fc13d5043)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:54.325451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:54.509575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4651c9491d0f43dabf050a1fc13d5043'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.510145 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4651c9491d0f43dabf050a1fc13d5043'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.522126 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4651c9491d0f43dabf050a1fc13d5043'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.529396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4651c9491d0f43dabf050a1fc13d5043'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.610903 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-8d3a32c9-7960-4537-903d-1547d9eccc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4651c9491d0f43dabf050a1fc13d5043'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:54.616937 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1291/2610] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:58:54 2022] DELETE /identity/v3/users/4651c9491d0f43dabf050a1fc13d5043 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:55.023882 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:55.027354 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:55.038325 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6d20-0f9b-4635-981a-4924af1e0a7d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:55.096826 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:55.097453 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.097730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.098003 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] PATH_INFO: `/v3/projects/9c3ec335368d4dbfa6bcb76e434e99b7` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.099109 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3ec335368d4dbfa6bcb76e434e99b7)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:55.101096 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:55.208994 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3ec335368d4dbfa6bcb76e434e99b7', 'request_id': 'req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:55.214659 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3ec335368d4dbfa6bcb76e434e99b7', 'request_id': 'req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:55.220976 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3ec335368d4dbfa6bcb76e434e99b7', 'request_id': 'req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:55.301542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] The token cache is being invalidate because project 9c3ec335368d4dbfa6bcb76e434e99b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:58:55.301825 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:55.302430 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4dfbac43-3cb5-48db-b700-eafb8a9cc03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:58:55.303907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1320/2611] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:58:55 2022] DELETE /identity/v3/projects/9c3ec335368d4dbfa6bcb76e434e99b7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:58:55.309406 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63c1a-65b8-4788-a641-cd227a243006 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.312494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63c1a-65b8-4788-a641-cd227a243006 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.312494 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e63c1a-65b8-4788-a641-cd227a243006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.329242 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-f5e63c1a-65b8-4788-a641-cd227a243006 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:55.330562 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-f5e63c1a-65b8-4788-a641-cd227a243006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:55.359962 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:55.389413 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1292/2612] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:55.398842 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcfecd-4bc3-4e38-9524-9fc61fae1576 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.399356 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcfecd-4bc3-4e38-9524-9fc61fae1576 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.399627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcfecd-4bc3-4e38-9524-9fc61fae1576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.420405 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9cbcfecd-4bc3-4e38-9524-9fc61fae1576 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:55.421633 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9cbcfecd-4bc3-4e38-9524-9fc61fae1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:55.429452 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1321/2613] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:55.434208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63c1a-65b8-4788-a641-cd227a243006 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:55.443497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e63c1a-65b8-4788-a641-cd227a243006 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:55.448297 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:55.448940 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.449218 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.449490 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.450135 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:58:55.450438 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:55.452100 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:55.463768 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1293/2614] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:58:55.469887 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcfecd-4bc3-4e38-9524-9fc61fae1576 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:55.479085 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcfecd-4bc3-4e38-9524-9fc61fae1576 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:55.484330 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:55.484948 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.485228 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.485503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.486144 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:55.488058 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:55.497535 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:58:55.595907 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1322/2615] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:58:55 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 07:58:55.600114 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:55.610652 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921c9f-afe2-4809-9530-6f3dae968f2f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:55.665478 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:55.666076 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.666351 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.666619 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.667248 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:55.669742 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:55.753575 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1294/2616] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:58:55 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:58:55.757646 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:55.768005 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd01c-59b6-4d02-a0f6-22c694c2815d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:55.772690 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:55.773280 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.773558 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.773828 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.774460 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:55.776051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:55.786672 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1323/2617] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:55.790620 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:55.801290 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94702b0-0f57-4424-a27e-791c984f364f admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:55.805955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52300c2a-f607-4f31-ac11-15009aa5a194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:55.806529 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52300c2a-f607-4f31-ac11-15009aa5a194 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.806877 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52300c2a-f607-4f31-ac11-15009aa5a194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.807146 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52300c2a-f607-4f31-ac11-15009aa5a194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.807769 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52300c2a-f607-4f31-ac11-15009aa5a194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:55.809396 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52300c2a-f607-4f31-ac11-15009aa5a194 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:55.819803 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1295/2618] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:58:55.824421 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:55.834124 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adb6bd-5257-4b54-8e02-1ef1011b736a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:55.838634 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:55.839904 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.840181 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.840477 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] PATH_INFO: `/v3/projects/10232fbaff7243a48b3d26e097d33128/users/a48d04f0119c4639b1017ae948f91815/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.855051 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=10232fbaff7243a48b3d26e097d33128, user_id=a48d04f0119c4639b1017ae948f91815, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:55.857748 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:55.919597 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1324/2619] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:58:55 2022] PUT /identity/v3/projects/10232fbaff7243a48b3d26e097d33128/users/a48d04f0119c4639b1017ae948f91815/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:58:55.929837 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b790-13ae-4ba4-9058-79401b0fb253 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:55.930154 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b790-13ae-4ba4-9058-79401b0fb253 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:55.930450 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b790-13ae-4ba4-9058-79401b0fb253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:55.958050 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b8c6b790-13ae-4ba4-9058-79401b0fb253 None None] MFA Rules not processed for user `a48d04f0119c4639b1017ae948f91815`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:58:55.959254 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b8c6b790-13ae-4ba4-9058-79401b0fb253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:56.021432 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1296/2620] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:58:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:58:56.033299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:58:56.035035 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:58:56.092730 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4af45e-b7b2-43c3-bf62-b5dfc965b6ec admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:58:56.096355 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de2f82-fd4e-4c5d-928f-116ea7ac711f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:58:56.096971 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de2f82-fd4e-4c5d-928f-116ea7ac711f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:58:56.097241 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de2f82-fd4e-4c5d-928f-116ea7ac711f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:58:56.097503 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de2f82-fd4e-4c5d-928f-116ea7ac711f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:58:56.105622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de2f82-fd4e-4c5d-928f-116ea7ac711f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:58:56.106966 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de2f82-fd4e-4c5d-928f-116ea7ac711f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:58:56.115590 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1325/2621] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:58:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:59:06.018535 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:06.111606 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:13.828449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b790-13ae-4ba4-9058-79401b0fb253 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:13.889083 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b790-13ae-4ba4-9058-79401b0fb253 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:13.893595 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:13.894208 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:13.894488 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:13.894761 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] PATH_INFO: `/v3/users/a48d04f0119c4639b1017ae948f91815` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:13.895866 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48d04f0119c4639b1017ae948f91815)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:13.897814 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:14.110223 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48d04f0119c4639b1017ae948f91815'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.111445 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48d04f0119c4639b1017ae948f91815'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.128357 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48d04f0119c4639b1017ae948f91815'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.135449 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48d04f0119c4639b1017ae948f91815'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.216747 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48d04f0119c4639b1017ae948f91815'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.223794 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1297/2622] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:59:13 2022] DELETE /identity/v3/users/a48d04f0119c4639b1017ae948f91815 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:59:14.228363 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:14.228874 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:14.228991 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:14.248824 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:59:14.251358 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:14.308476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1326/2623] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 07:59:14.318052 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:14.319433 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:14.375649 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ccf1c-7485-41e0-b292-7d5a4d2b0ed7 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:14.379189 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f2015-15d8-4789-a648-1edb24b6e4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:14.379778 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f2015-15d8-4789-a648-1edb24b6e4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:14.380054 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f2015-15d8-4789-a648-1edb24b6e4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:14.380330 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f2015-15d8-4789-a648-1edb24b6e4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:14.389084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f2015-15d8-4789-a648-1edb24b6e4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:14.390499 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f2015-15d8-4789-a648-1edb24b6e4f0 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:14.400304 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1298/2624] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 07:59:14.793553 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:14.794965 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:14.807053 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c4024-818a-450c-b1db-c777f7e5f533 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:14.811680 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:14.812304 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:14.812610 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:14.812885 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] PATH_INFO: `/v3/projects/10232fbaff7243a48b3d26e097d33128` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:14.814514 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=10232fbaff7243a48b3d26e097d33128)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:14.816495 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:14.919262 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10232fbaff7243a48b3d26e097d33128', 'request_id': 'req-7a6d68bb-3894-4a16-b12e-982d52590edd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.924655 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10232fbaff7243a48b3d26e097d33128', 'request_id': 'req-7a6d68bb-3894-4a16-b12e-982d52590edd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.930936 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10232fbaff7243a48b3d26e097d33128', 'request_id': 'req-7a6d68bb-3894-4a16-b12e-982d52590edd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.992574 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] The token cache is being invalidate because project 10232fbaff7243a48b3d26e097d33128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:59:14.992855 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.993481 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7a6d68bb-3894-4a16-b12e-982d52590edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:14.995025 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1327/2625] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:59:14 2022] DELETE /identity/v3/projects/10232fbaff7243a48b3d26e097d33128 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 07:59:14.999986 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f23f8-35e0-4afd-8a60-82c18efecfa1 None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.001762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f23f8-35e0-4afd-8a60-82c18efecfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.001762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f23f8-35e0-4afd-8a60-82c18efecfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.021130 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-581f23f8-35e0-4afd-8a60-82c18efecfa1 None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:59:15.022309 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-581f23f8-35e0-4afd-8a60-82c18efecfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:15.038869 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:15.081385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1299/2626] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:59:15.089508 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cd0d9-e935-46c8-bd09-f4e5d8c0a3af None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.089791 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cd0d9-e935-46c8-bd09-f4e5d8c0a3af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.090090 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cd0d9-e935-46c8-bd09-f4e5d8c0a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.110130 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-746cd0d9-e935-46c8-bd09-f4e5d8c0a3af None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:59:15.111438 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-746cd0d9-e935-46c8-bd09-f4e5d8c0a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:15.119458 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1328/2627] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:59:15.123971 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f23f8-35e0-4afd-8a60-82c18efecfa1 None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:15.134793 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f23f8-35e0-4afd-8a60-82c18efecfa1 None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:15.139302 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:15.139886 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.140158 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.140423 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] PATH_INFO: `/v3/domains` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.141084 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 07:59:15.141385 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:15.143542 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:15.154762 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1300/2628] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Nov 2 07:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 07:59:15.159294 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cd0d9-e935-46c8-bd09-f4e5d8c0a3af None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:15.168705 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cd0d9-e935-46c8-bd09-f4e5d8c0a3af None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:15.173998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:15.174525 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.174801 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.175071 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.175695 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:15.177611 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:15.251559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1329/2629] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Nov 2 07:59:15 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:59:15.256220 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:15.266003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365d5c4-e6fc-4b2c-be8e-9a04680dc904 admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:15.321318 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:15.321920 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.322198 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.322471 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] PATH_INFO: `/v3/users` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.323088 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:15.325037 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:15.468281 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1301/2630] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Nov 2 07:59:15 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 07:59:15.472327 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:15.482492 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c18cc9-282c-4760-ab51-1839fce31225 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:15.487683 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:15.488275 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.488576 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.488843 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.489476 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:15.491434 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:15.502324 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1330/2631] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:59:15.506060 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:15.515672 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be3c6f-b067-4af9-ae9c-0cd041e0ec3a admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:15.520226 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0f8f-2e66-4e0d-9d39-a1498bbd4e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:15.520827 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0f8f-2e66-4e0d-9d39-a1498bbd4e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.521103 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0f8f-2e66-4e0d-9d39-a1498bbd4e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.521370 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0f8f-2e66-4e0d-9d39-a1498bbd4e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.521995 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc0f8f-2e66-4e0d-9d39-a1498bbd4e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:15.523587 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc0f8f-2e66-4e0d-9d39-a1498bbd4e09 admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:15.534637 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1302/2632] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Nov 2 07:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 07:59:15.538486 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:15.549056 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f14c2-35ee-4a96-bd0e-9ed969340325 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:15.553627 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:15.554267 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.554552 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.554848 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] PATH_INFO: `/v3/projects/030009db6a96456eb76821b8815830f6/users/941942f7b91e4b9f8b07c77e149bfe08/roles/781606224bfd4b6887aa0c545e3af45a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.570872 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=030009db6a96456eb76821b8815830f6, user_id=941942f7b91e4b9f8b07c77e149bfe08, role_id=781606224bfd4b6887aa0c545e3af45a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:15.573557 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:15.639057 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1331/2633] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Nov 2 07:59:15 2022] PUT /identity/v3/projects/030009db6a96456eb76821b8815830f6/users/941942f7b91e4b9f8b07c77e149bfe08/roles/781606224bfd4b6887aa0c545e3af45a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:59:15.650267 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64169ea-a6bc-4b57-8f2e-3a863b3499ea None None] REQUEST_METHOD: `POST` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.650654 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64169ea-a6bc-4b57-8f2e-3a863b3499ea None None] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.650957 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64169ea-a6bc-4b57-8f2e-3a863b3499ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.680688 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.auth.core [None req-b64169ea-a6bc-4b57-8f2e-3a863b3499ea None None] MFA Rules not processed for user `941942f7b91e4b9f8b07c77e149bfe08`. Rule list: `[]` (Enabled: `True`). {{(pid=81601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:59:15.681890 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-b64169ea-a6bc-4b57-8f2e-3a863b3499ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:15.744927 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1303/2634] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:59:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:59:15.756299 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:15.757998 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:15.779422 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:15.814559 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74be8a-1322-494d-878c-d43f8d379e6a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:15.818219 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66ca58-9f52-4a42-932b-290369debeef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ee11e2d4324bb7a9b83c8fd2b98bb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:15.823431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66ca58-9f52-4a42-932b-290369debeef service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:15.823431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66ca58-9f52-4a42-932b-290369debeef service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:15.823431 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66ca58-9f52-4a42-932b-290369debeef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:15.827456 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66ca58-9f52-4a42-932b-290369debeef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:15.828917 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66ca58-9f52-4a42-932b-290369debeef service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:15.837940 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1332/2635] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:59:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:59:20.003474 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64169ea-a6bc-4b57-8f2e-3a863b3499ea None None] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:20.022621 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:20.065480 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64169ea-a6bc-4b57-8f2e-3a863b3499ea None None] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:20.069876 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:20.070497 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:20.070772 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:20.071042 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] PATH_INFO: `/v3/users/941942f7b91e4b9f8b07c77e149bfe08` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:20.072179 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=941942f7b91e4b9f8b07c77e149bfe08)` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:20.074109 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:20.256968 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941942f7b91e4b9f8b07c77e149bfe08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:20.257560 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941942f7b91e4b9f8b07c77e149bfe08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:20.269884 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941942f7b91e4b9f8b07c77e149bfe08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:20.276662 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941942f7b91e4b9f8b07c77e149bfe08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:20.336545 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.notifications [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941942f7b91e4b9f8b07c77e149bfe08'} {{(pid=81601) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:20.342414 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1304/2636] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Nov 2 07:59:20 2022] DELETE /identity/v3/users/941942f7b91e4b9f8b07c77e149bfe08 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:59:20.346983 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:20.347542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:20.347542 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:20.366238 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] MFA Rules not processed for user `c3037fdb5af64eb3a7204825aff76bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 07:59:20.367419 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:20.426670 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1333/2637] 10.222.0.39 () {58 vars in 958 bytes} [Wed Nov 2 07:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 07:59:20.436349 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:20.437744 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:20.494175 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f10c6-3da1-45e3-a843-66ad73d1fa5c admin admin] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:20.497861 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e4cc87886d4b7788864eaf94334e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:20.498451 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:20.498730 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:20.499003 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:20.508589 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:20.509828 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:20.519118 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1305/2638] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 07:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 07:59:20.930963 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 07:59:20.932392 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 07:59:20.944677 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25912-c746-4cb6-8239-9196de85fc9f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 07:59:20.949333 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3037fdb5af64eb3a7204825aff76bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2956e4c40564dd2b6b8960e97f61ae3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 07:59:20.949959 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 07:59:20.950652 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 07:59:20.951088 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] PATH_INFO: `/v3/projects/030009db6a96456eb76821b8815830f6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 07:59:20.952402 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=030009db6a96456eb76821b8815830f6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 07:59:20.954451 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 07:59:21.067635 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030009db6a96456eb76821b8815830f6', 'request_id': 'req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:21.073069 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030009db6a96456eb76821b8815830f6', 'request_id': 'req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:21.079336 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030009db6a96456eb76821b8815830f6', 'request_id': 'req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:21.147850 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] The token cache is being invalidate because project 030009db6a96456eb76821b8815830f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 07:59:21.152728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:21.152728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e234a6c6-a0b7-429b-8e62-60a4d4ed1a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 07:59:21.152728 dv-cinder-778193-30-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1334/2639] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Nov 2 07:59:20 2022] DELETE /identity/v3/projects/030009db6a96456eb76821b8815830f6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 07:59:30.514894 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 07:59:31.144622 dv-cinder-778193-30-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 08:00:20.153544 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] Authenticating user token {{(pid=81601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 08:00:20.154955 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:20.243960 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cab3c-8478-4457-a9a2-b67a5aec7b04 service neutron] Validating token access rules against request {{(pid=81601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 08:00:20.299929 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09427e0-3a4e-482b-8308-f0adedbe8900 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c641dd28386e464cad2add5e42c5a518', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53cdb029f8b44b528a7a359134d30806', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 08:00:20.300539 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09427e0-3a4e-482b-8308-f0adedbe8900 service placement] REQUEST_METHOD: `GET` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 08:00:20.300816 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09427e0-3a4e-482b-8308-f0adedbe8900 service placement] SCRIPT_NAME: `/identity` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 08:00:20.301113 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09427e0-3a4e-482b-8308-f0adedbe8900 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 08:00:20.302783 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.fernet_utils [None req-d09427e0-3a4e-482b-8308-f0adedbe8900 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 08:00:20.314006 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09427e0-3a4e-482b-8308-f0adedbe8900 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 08:00:20.315553 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09427e0-3a4e-482b-8308-f0adedbe8900 service placement] RBAC: Authorization granted {{(pid=81601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 08:00:20.325139 dv-cinder-778193-30-smb devstack@keystone.service[81601]: [pid: 81601|app: 0|req: 1306/2640] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Nov 2 08:00:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 08:00:30.320963 dv-cinder-778193-30-smb devstack@keystone.service[81601]: DEBUG dbcounter [-] [81601] Writing DB stats keystone:SELECT=67 {{(pid=81601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}